Skip to content
Review Open access

Explainable and Feature-Engineered Machine Learning for Stock Market Forecasting: A Survey of Lexicon-Based, Statistical, and Sentiment-Driven Approaches

Oct 2026 · International Journal for Research in Applied Science and Engineering Technology · 0 citations

Abstract

Forecasting the direction and magnitude of stock price movements remains one of the most persistently difficult problems in applied machine learning, owing to the noisy, non-stationary, and weak-form-efficient character of financial time series. This survey examines three recent studies that approach the problem through complementary lenses: an explainable Decision Tree that builds dynamic, industry-specific lexicons from financial news to classify next-day price-change magnitude [1]; a feature-engineering and portfolio-construction pipeline that derives new price-based predictors via Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA), and a proposed Statistical Average Method (SAM) before applying eight regression architectures, including Bi-LSTM [2]; and an LSTM-based trend classifier that fuses FinBERT-scored Twitter sentiment with price data to forecast North American and European bank-stock movements during the macroeconomically turbulent year of 2022 [3]. Beyond summarising each study's objectives, methodology, data, and results, this survey situates the three works within the broader and rapidly evolving literature on deep sequence models (LSTM, Bi-LSTM, GRU, and transformer architectures), sentiment analysis with pretrained financial language models such as FinBERT, and explainable artificial intelligence (XAI) in finance. A structured comparative analysis contrasts the three studies along ten dimensions, including data sources, feature engineering, model architecture, explainability, validation design, and reported performance, while explicitly cautioning against directly ranking studies whose prediction tasks and evaluation metrics are not commensurable. A cross-domain case study of an attention-based legislative-vote predictor is retained to examine whether a learned similarity mechanism could improve on the fixed similarity rules used throughout the finance literature reviewed here. The survey's contribution lies in bringing explainable lexicon-based methods, statistically engineered price features, and sentiment-driven deep learning together within a single comparative framework, and in using that synthesis to identify concrete, evidence-grounded gaps around auxiliary-signal fusion, the explainability of high-accuracy sequence models, and cross-market generalisation.

Read PDF

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.