Skip to content
Open access

VERIFYRAG: A Dual-Layer Hallucination Detection Framework Combining Semantic Consistency Scoring and NLI-Based Evidence Grounding For Open-Domain LLMS

Oct 2026 · Adolescência e Saúde · 0 citations · 20 references

TL;DR

VerifyRAG, a lightweight, open-source pipeline for detecting and mitigating hallucinations that incorporates a unique dual-layer verification architecture, is proposed in this study, providing a repeatable and economical approach for the implementation of LLM in the real world.

Abstract

Large Language Models (LLMs) are being used more and more in knowledge-intensive tasks, yet they often provide outputs that are factually inaccurate with high confidence, a phenomenon known as hallucinated content. Current methods have little practical utility because they either address detection and mitigation separately or rely on costly proprietary APIs. VerifyRAG, a lightweight, open-source pipeline for detecting and mitigating hallucinations that incorporates a unique dual-layer verification architecture, is proposed in this study. Semantic consistency is used in Layer 1. Semantic alignment between LLM-generated replies and retrieved contextual data is scored using Sentence-BERT. Using DeBERTa-v3, Layer 2 employs Natural Language Inference (NLI)-based Evidence Grounding to categorise each assertion as Entailed, Neutral, or Contradicted in relation to retrieved documents. When the risk of hallucinations is high, a confidence scoring engine that fuses the two layers automatically corrects the response.The system is tested using the TriviaQA, HaluEval, and FEVER benchmarks and is based solely on open-source models. The findings of the experiment show a considerable decrease in the rate of hallucinations while preserving competitive response quality, providing a repeatable and economical approach for the implementation of LLM in the real world.

Read PDF

Similar papers

Open access Sep 2026

Evaluating the Efficiency of Large Language Models in Detecting and Mitigating Hallucinations Using a Curated Domain-Oriented Dataset and Post-Hoc Retrieval

Results show that relevant external evidence can improve the reliability and consistency of LLM based hallucination detection and the proposed approach uses retrieval to verify claims and reclassify responses when the initial judgment needs evidence.

Chandra Sekhar Sanaboina, T. Surekha · 0 citations
#artificial intelligence Preprint Sep 2026

Leveraging Low-Level Symbolic Competences for Unsupervised Grounding in Hallucination Detection

This work investigates whether an LLM can use an alternative, low level, symbolic competence such as SQL for unsupervised hallucination detection in some high level task and finds that this approach improves on direct prediction and competes with state-of-the-art hallucination detection methods, while not requiring dom...

Renato Vukovic, Hsien-Chin Lin, Carel van Niekerk et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Domain-Specific Hallucination Detection in Large Language Models

A multi-signal detection pipeline combining fine-tuned DeBERTa-v3 classification, Monte Carlo Dropout uncertainty quantification, and temperature-scaled calibration for response-level hallucination detection is presented.

Varun Teja Chundru, Debasmita Biswas · 0 citations
#large language models Open access Sep 2026

Hallucinations in Structured Extraction: A Case Study on Prompt-Based Semantic Role Labeling

This paper studies hallucinations in structured extraction using prompt-based Semantic Role Labeling (SRL) as a controlled case study. We implement a DSPy-based pipeline in which each prediction includes a generated rationale and a citation to a governing rule, allowing extraction errors to be aggregated by attributed...

Ioannis Kazlaris, Konstantinos I. Diamantaras, E. Antoniou et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.