Oct 2026· Adolescência e Saúde· 0 citations· 20 references
TL;DR
VerifyRAG, a lightweight, open-source pipeline for detecting and mitigating hallucinations that incorporates a unique dual-layer verification architecture, is proposed in this study, providing a repeatable and economical approach for the implementation of LLM in the real world.
Abstract
Large Language Models (LLMs) are being used more and more in knowledge-intensive tasks, yet they often provide outputs that are factually inaccurate with high confidence, a phenomenon known as hallucinated content. Current methods have little practical utility because they either address detection and mitigation separately or rely on costly proprietary APIs. VerifyRAG, a lightweight, open-source pipeline for detecting and mitigating hallucinations that incorporates a unique dual-layer verification architecture, is proposed in this study. Semantic consistency is used in Layer 1. Semantic alignment between LLM-generated replies and retrieved contextual data is scored using Sentence-BERT. Using DeBERTa-v3, Layer 2 employs Natural Language Inference (NLI)-based Evidence Grounding to categorise each assertion as Entailed, Neutral, or Contradicted in relation to retrieved documents. When the risk of hallucinations is high, a confidence scoring engine that fuses the two layers automatically corrects the response.The system is tested using the TriviaQA, HaluEval, and FEVER benchmarks and is based solely on open-source models. The findings of the experiment show a considerable decrease in the rate of hallucinations while preserving competitive response quality, providing a repeatable and economical approach for the implementation of LLM in the real world.
Results show that relevant external evidence can improve the reliability and consistency of LLM based hallucination detection and the proposed approach uses retrieval to verify claims and reclassify responses when the initial judgment needs evidence.
Chandra Sekhar Sanaboina, T. Surekha· International Journal of Inn...· 0 citations
This work investigates whether an LLM can use an alternative, low level, symbolic competence such as SQL for unsupervised hallucination detection in some high level task and finds that this approach improves on direct prediction and competes with state-of-the-art hallucination detection methods, while not requiring dom...
Renato Vukovic, Hsien-Chin Lin, Carel van Niekerk et al.· 0 citations
A multi-signal detection pipeline combining fine-tuned DeBERTa-v3 classification, Monte Carlo Dropout uncertainty quantification, and temperature-scaled calibration for response-level hallucination detection is presented.
This paper studies hallucinations in structured extraction using prompt-based Semantic Role Labeling (SRL) as a controlled case study. We implement a DSPy-based pipeline in which each prediction includes a generated rationale and a citation to a governing rule, allowing extraction errors to be aggregated by attributed...
Ioannis Kazlaris, Konstantinos I. Diamantaras, E. Antoniou et al.· Machine Learning and Knowled...· 0 citations
A thorough comparative analysis using a variety of metrics of ten advanced LLMs shows a fundamental trade-off between response completeness and factual reliability, intensified by prompt complexity.
Osama Shabih, Dayam Nadeem, S. Sohail et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.