Skip to content
Review Open access

A Cognitive-Inspired Scanning Framework for Topic Modeling and Document Classification

Aug 2026 · Journal of Intelligent Decision Making and Information Science · Vol 3, pp. 1565-1576 · 0 citations · 39 references

TL;DR

This work proposes an innovative method that combines scanning (skimming) reading techniques with Latent Dirichlet Allocation (LDA) to enable an efficient exploration and an overview analysis of massive text corpora.

Abstract

As digital textual data continues to grow exponentially, it becomes progressively harder to extract information from large collections of documents. Traditional full-text analysis methods often require substantial time and computational resources. This challenge is particularly relevant for massive corpora where important information is dispersed across different documents. This dispersion makes rapid comprehension difficult. Therefore, we propose an innovative method that combines scanning (skimming) reading techniques with Latent Dirichlet Allocation (LDA). This method enables an efficient exploration and an overview analysis of massive text corpora. Our approach leverages scanning as a rapid information extraction strategy in press articles. It identifies key and representative textual segments without the need for exhaustive reading. This preliminary filtering mechanism reduces processing complexity while preserving essential semantic content. To complement this step, we employ LDA to model latent topics and cluster documents based on their thematic structures. Unlike surface-level analysis, LDA exposes hidden topic distributions within the corpus, enabling the identification of both dominant topics and latent subtopics. Through the integration of scanning with LDA, we provide a structured framework to explore extensive collections of press articles. The scanning phase improves efficiency through the refinement of the textual scope. Meanwhile, LDA provides a robust probabilistic topic model and groups articles accordingly. This synergy facilitates a comprehensive understanding of the texts at both macro and micro levels.

Read PDF

Similar papers

#large language models Open access Oct 2026

Classical Tricks for Better Topics: Can Traditional Text Mining Techniques Improve Generative Topic Modeling?

Topic modeling is widely used to discover and organize latent themes in large text collections. While recent embedding-based methods have improved topic discovery by leveraging dense semantic representations, they typically represent topics as lists of keywords, often providing limited insights into the underlying them...

Isis Meira, Isabella Leite, Gabriel Assis et al. · 0 citations
#small language model Open access Oct 2026

A new latent Dirichlet allocation for enhancing sentiment analysis in social network

The volume of sentiment-rich text data produced on a daily basis by social network sites such as Twitter is very large. However, traditional approaches to sentiment analysis, especially approaches based on the Bag-of-Words (BoW) model have a difficult time modeling more subtle thematic content structure and interrelati...

Fazidah Wahit, N. Sani, Salwani Abdullah · 0 citations
Open access Oct 2026

Semantic Representations based on Neural Topic Models

A Neural Topic Model called ABT is presented which leverages semantic vector spaces (derived from language models) to uncover latent semantic representations in text collections to explore the themes covered by a given textual collection and analyze them as a hierarchical structure of topics.

Fagner Leal Pantoja, A. Santanchè, C. B. Medeiros · 0 citations
#machine learning Open access Oct 2026

TopicMerge: A Divide and Conquer Approach to Topic Modeling

Recent advancements in topic modeling have split into two main paths: efficient embedding-based methods that offer scalability but are often outperformed on standard clustering metrics, and Large Language Model (LLM) approaches that achieve state-of-the-art clustering performance but at the cost of prohibitive computat...

Matthew Raffel, Li-Zhong Chen, Sai Munikoti et al. · 0 citations

Segment-Level Agentic Topic Modeling for Improved Data Exploration and Resource Efficiency

This paper introduces a framework called SeLATM, which addresses topic assignment process concerns by employing segment-level topic generation and topic refinement through agentic feedback loops, and significantly reduces the LLM resources compared to methods based on topic assignment process, while maintaining superio...

Myeongjun Erik Jang, Antonios Georgiadis, S. Moon et al. · 0 citations
Review Open access Oct 2026

Enhanced Short-Text Clustering Based on a Multirepresentation Fusion Model

Short-text clustering has become increasingly important because of the exponential growth of textual data. However, traditional methods struggle with sparsity, limited context, and poor cluster cohesion. Recently, innovations have made word embedding algorithms, including Word2Vec, GloVe, and FastText, available for ef...

Ali Sabah, D. Mohammed, Zaid Alaa · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.