A lightweight, semi-supervised, and reproducible framework that achieves competitive performance without relying on resource-intensive models for hallucination detection across three natural language processing tasks, including machine translation, definition modeling, and paraphrase generation is presented.
Abstract
Large Language Models have advanced natural language generation, but they often produce outputs that are grammatically correct yet factually incorrect or misleading. This issue, commonly known as hallucination, reduces the reliability of such systems, especially in domains such as law, medicine, journalism, and education, where factual accuracy is important. This work presents a systematic low-resource framework for hallucination detection across three natural language processing tasks, including machine translation, definition modeling, and paraphrase generation. The experiments are conducted on the SemEval 2024 Task 6 SHROOM dataset, which consists of a small labeled set and a larger set of unlabeled data across three text generation tasks. An iterative self-training approach based on transformer models is employed, where a small manually labeled set is expanded using confidence-based pseudo-labeling. Active learning, ensemble methods and a Query by Committee strategy are used to guide sample selection and improve stability under limited supervision. The models are evaluated using accuracy and Spearman correlation to capture classification performance and prediction consistency. The proposed setup achieves an accuracy of 0.78 and a Spearman correlation of 0.6626. In addition, QLoRA-based large language models are evaluated as lightweight baselines for comparison with the proposed framework. The work presents a lightweight, semi-supervised, and reproducible framework that achieves competitive performance without relying on resource-intensive models. It serves as a practical baseline, highlights key challenges, and provides a foundation for more advanced hallucination detection systems in real-world applications.
A multi-signal detection pipeline combining fine-tuned DeBERTa-v3 classification, Monte Carlo Dropout uncertainty quantification, and temperature-scaled calibration for response-level hallucination detection is presented.
This work investigates whether an LLM can use an alternative, low level, symbolic competence such as SQL for unsupervised hallucination detection in some high level task and finds that this approach improves on direct prediction and competes with state-of-the-art hallucination detection methods, while not requiring dom...
Renato Vukovic, Hsien-Chin Lin, Carel van Niekerk et al.· 0 citations
A supervised ensembling framework that trains a classifier over heterogeneous UQ-based scorer outputs on a small, domain-specific dataset of labeled LLM responses, then applies it to out-of-sample hallucination classification without retrieval, tools, or reference documents is studied.
In recent years, several methods for detecting when large language models (LLMs) hallucinate have been developed. These methods are often benchmarked with open-domain question answering (QA) datasets containing questions and corresponding short reference answers. First, an LLM is used to generate answers to questions w...
J. Valjakka, Juhani Kivimäki, Juha Mylläri et al.· 0 citations
It is shown that epistemic uncertainty leaves a measurable trace within intermediate layers, where spikes in attention entropy are associated with reasoning breakdowns, and that attention dispersion is a promising complement to traditional hallucination detection methods.
S. More, Tanuja S. Pawar· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduNov 20, 2026
Senior Research Scientist Jim Glass discusses how his MIT-IBM Computing Research Lab collaboration connects perception and language, and addresses the shortcoming of current models.
MIT News · Artificial Intelligence· news.mit.eduNov 20, 2026
Enforcing physics-based constraints prevents AI models from generating unreliable predictions for complex nonlinear systems in weather, climate, and turbulent flows.
An MIT and Dana-Farber Institute-led team used large language models to examine nearly 4,000 studies and hundreds of code repositories, revealing gaps in the information needed to scrutinize and reuse published research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.