Aug 2026· Jurnal Teknik Informatika (Jutif)· Vol 7, pp. 3414-3428· 0 citations
TL;DR
The results showed that the GA+LDA+k-NN approach significantly improved the classification accuracy compared to traditional feature selection methods such as Chi-Square, Information Gain, and Mutual Information, confirming the urgency of using evolutionary optimization-based feature selection methods in high-dimensional text classification.
Abstract
Text classification is an important task in natural language processing that faces the main challenge of high dimensionality in the representation of text features, such as Bag-of-Words and TF-IDF. High dimensionality leads to data sparsity, increased computational complexity, and decreased model performance due to irrelevant and redundant features. Therefore, an effective feature selection method is needed to improve the accuracy and efficiency of text classification. This study aims to develop an optimal feature selection method by integrating Genetic Algorithm (GA) as a wrapper method, Linear Discriminant Analysis (LDA) for dimension reduction, and k-Nearest Neighbors (k-NN) as a classifier in a high-dimensional text classification pipeline. GA is used to explore a subset of features in an adaptive and global manner, LDA transforms features into spaces with maximum class separability, and k-NN classifies based on proximity within optimized feature spaces. Experiments were conducted on three standard text datasets, namely 20 Newsgroups, Reuters-21578, and BBC News, with a comprehensive evaluation using a variety of preprocessing configurations and feature representations. The results showed that the GA+LDA+k-NN approach significantly improved the classification accuracy compared to traditional feature selection methods such as Chi-Square, Information Gain, and Mutual Information. This approach is also more robust against noise and is able to handle minority classes better. These findings confirm the urgency of using evolutionary optimization-based feature selection methods in high-dimensional text classification, which not only improves model performance but also provides a practical solution for large-scale and complex text data processing. Thus, this research makes an important contribution both theoretically and applicatively in the development of modern text classification systems.
This paper proposes LIDFS, an unsupervised feature selection method based on Local Intrinsic Dimensionality (LID), which builds on the formal equivalence between LID and the indiscriminability of distance measures.
Oussama Chelly, Michael E. Houle, K. Kawarabayashi et al.· 0 citations
We introduce a robust classification model designed for feature selection. Support vector machine (SVM) models continue to play a crucial role in binary classification, particularly with tabular data. Their robust variants are essential for developing classifiers that remain stable despite shifts in data distribution...
Miguel Carrasco, B. Ivorra, Julio López et al.· Journal of Convex Analysis· 0 citations
Sentiment analysis has become a crucial task in natural language processing for extracting meaningful insights from textual data. This research proposes a hybrid model using optimization techniques to enhance the accuracy and efficiency of sentiment classification. The proposed framework begins with a comprehensive pre...
P. Manigandan, N. Zachariah· RCHUB JOURNAL OF COMPUTATION...· 0 citations
Despite creating opportunities, platforms with large-scale data also pose significant computational challenges. An issue with high-dimensional data is that in many cases, not all of the data's features are important or vital for uncovering the knowledge hidden within it. Due to this, reducing the dimensionality of data...
S. Dehghani, Razieh Malekhosseini, Karamollah Bagherifard et al.· Management Strategies and En...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.