Aug 2026· JITK (Jurnal Ilmu Pengetahuan dan Teknologi Komputer)· 0 citations· 31 references
TL;DR
Empirical evidence is provided that, within the present experimental configuration, a properly optimized weighted loss strategy offers a viable and computationally efficient alternative to synthetic oversampling for BERT-based Twitter sentiment classification.
Abstract
The widespread adoption of ChatGPT has generated extensive public discourse across social media, necessitating robust sentiment analysis to understand collective opinions. Traditional approaches frequently employ the Synthetic Minority Over-sampling Technique (SMOTE) to address class imbalance; however, its effectiveness on short-text data remains an open question. This study develops an optimized sentiment classification model and evaluates whether competitive performance can be achieved without synthetic data augmentation. The methodology encompasses comprehensive Natural Language Processing (NLP) preprocessing and stratified data partitioning to preserve distributional characteristics. A BERT-base architecture is fine-tuned using a class-weighted Cross-Entropy loss combined with weighted random sampling, deliberately avoiding SMOTE-based oversampling. The model is trained with the AdamW optimizer (learning rate: 3 × 10⁻⁵), batch size 32, and mixed-precision training for four epochs. On 198,639 preprocessed tweets, the proposed approach achieves 93.81% accuracy, with weighted precision, recall, and F1-score of 0.9365, 0.9381, and 0.9380 respectively, outperforming the baseline by 1.75 percentage points. Per-class analysis reveals strong performance for negative (F1-score: 0.96) and positive sentiment (F1-score: 0.94), with lower neutral classification (F1-score: 0.89), attributable to the inherent heterogeneity of neutral expressions. The training-validation gap remains below 5%, consistent with adequate regularization. These findings provide empirical evidence that, within the present experimental configuration, a properly optimized weighted loss strategy offers a viable and computationally efficient alternative to synthetic oversampling for BERT-based Twitter sentiment classification. Further controlled ablation studies and statistical validation are needed to establish generalizability.
The transition to electric vehicles in Indonesia has generated diverse public opinions on social media. Most previous sentiment analysis studies have tended to employ a single classification method without in-depth comparison and have overlooked the issue of extreme data imbalance, which can introduce bias into classif...
Experimental results on the Twitter US Airline Sentiment dataset demonstrate that the proposed framework achieves strong classification performance while maintaining low training complexity, highlighting the effectiveness of combining Large Language Model (LLM) based data augmentation with parameter‐efficient transform...
Hossein Nekkouei Nasrabadi, M. Moattar· Applied AI Letters· 1 citation
This paper presents a lightweight sentiment classification model based on Long Short-Term Memory networks, developed as a foundational text-analysis component for future multimodal emotion recognition systems, and provides a reproducible and computationally efficient baseline suitable for integration into broader multi...
Munmun Kakkar, Hemant Patidar· Natural Resources for Human...· 0 citations
A zero-shot classification pipeline that uses Natural Language Inference for classification of 1,000 tweets into a two-layer taxonomy of 30 parent topics and 330 subtopics has been created without any human-labeled samples.
Bhumit Peshavariya, S. Nahar· Informatica· 0 citations
This paper addresses the binary classification problem of identifying positive versus negative sentiment by proposing a hybrid framework that integrates generative, discriminative, and deep embedding-based models, and a weighted voting mechanism that leverages cross-validation to assign model-specific weights.
Apeksha Bhuekar· International Journal of Int...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.