Skip to content
Open access

Feature Selection Using Genetic Algorithm Combined with Linear Discriminant Analysis and k-Nearest Neighbors for High-Dimensional Text Classification

Aug 2026 · Jurnal Teknik Informatika (Jutif) · Vol 7, pp. 3414-3428 · 0 citations

TL;DR

The results showed that the GA+LDA+k-NN approach significantly improved the classification accuracy compared to traditional feature selection methods such as Chi-Square, Information Gain, and Mutual Information, confirming the urgency of using evolutionary optimization-based feature selection methods in high-dimensional text classification.

Abstract

Text classification is an important task in natural language processing that faces the main challenge of high dimensionality in the representation of text features, such as Bag-of-Words and TF-IDF. High dimensionality leads to data sparsity, increased computational complexity, and decreased model performance due to irrelevant and redundant features. Therefore, an effective feature selection method is needed to improve the accuracy and efficiency of text classification. This study aims to develop an optimal feature selection method by integrating Genetic Algorithm (GA) as a wrapper method, Linear Discriminant Analysis (LDA) for dimension reduction, and k-Nearest Neighbors (k-NN) as a classifier in a high-dimensional text classification pipeline. GA is used to explore a subset of features in an adaptive and global manner, LDA transforms features into spaces with maximum class separability, and k-NN classifies based on proximity within optimized feature spaces. Experiments were conducted on three standard text datasets, namely 20 Newsgroups, Reuters-21578, and BBC News, with a comprehensive evaluation using a variety of preprocessing configurations and feature representations. The results showed that the GA+LDA+k-NN approach significantly improved the classification accuracy compared to traditional feature selection methods such as Chi-Square, Information Gain, and Mutual Information. This approach is also more robust against noise and is able to handle minority classes better. These findings confirm the urgency of using evolutionary optimization-based feature selection methods in high-dimensional text classification, which not only improves model performance but also provides a practical solution for large-scale and complex text data processing. Thus, this research makes an important contribution both theoretically and applicatively in the development of modern text classification systems.  

Read PDF

Similar papers

Open access 2026

Robust SVM Classification with ℓ 0 -Norm Feature Selection

We introduce a robust classification model designed for feature selection. Support vector machine (SVM) models continue to play a crucial role in binary classification, particularly with tabular data. Their robust variants are essential for developing classifiers that remain stable despite shifts in data distribution...

Miguel Carrasco, B. Ivorra, Julio López et al. · 0 citations
Review Oct 2026

A SURVEY AND ANALYSIS OF SENTIMENT CLASSIFICATION USING MACHINE LEARNING ALGORITHMS

Sentiment analysis has become a crucial task in natural language processing for extracting meaningful insights from textual data. This research proposes a hybrid model using optimization techniques to enhance the accuracy and efficiency of sentiment classification. The proposed framework begins with a comprehensive pre...

P. Manigandan, N. Zachariah · 0 citations
Review Open access 2026

Feature Selection Methods for Data Dimensionality Reduction

Despite creating opportunities, platforms with large-scale data also pose significant computational challenges. An issue with high-dimensional data is that in many cases, not all of the data's features are important or vital for uncovering the knowledge hidden within it. Due to this, reducing the dimensionality of data...

S. Dehghani, Razieh Malekhosseini, Karamollah Bagherifard et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.