Review

Survey Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models

Yue Zhang Yafu Li Leyang Cui Deng Cai Lemao Liu Ting Fu Xinting Huang Enbo Zhao Yulong Chen Longyue Wang A. Lưu Wei Bi Freda Shi Shu-Ming Shi

· 0 citations · 190 references

TL;DR

Taxonomies of the LLM hallucination phenomena and evaluation benchmarks are presented, existing approaches aiming at mitigating LLM hallucination are analyzed, and potential directions for future research are discussed.

Semantic Scholar

View source

Similar papers

How to decrease LLMs’ hallucinations: a proposal

A natural way to decrease hallucinations is every time the authors have new pairs on which to train, they should also again train on the pairs corresponding to well-established facts and rules.

T. Ilina, M. Ceberio, Marcelo F. Frias et al. · 0 citations

#artificial intelligence Preprint Sep 2026

Hallucination Neurons and Where to Find Them: An Investigation into the existence of Hallucination Neurons

Interpretable machine learning for Large Language Models (LLMs) increasingly relies on sparse probing methods that identify small sets of neurons claimed to detect and causally influence behaviors such as factuality recall, safety alignment, and hallucination. These claims have important implications for model auditing...

Huseyin Cavus, Sebin Sabu, J. Spear et al. · 0 citations

Jun 2026

Indirected Reality

Language, truth, and LLMs How can LLMs appear to know facts about the world when they are trained only on patterns in language rather than direct experience of reality? Hallucinations shouldn’t surprise us. The real mystery is how these systems get anything right at all.

Jim Waldo · Queue · 0 citations

#artificial intelligence Preprint Sep 2026

NeuroActiSep: Detecting Factual Hallucinations from Feed-Forward Neurons in a Single Pass

This work proposes a method to rank feed-forward neurons at the final prompt token using a custom neuron selection dataset, and transfers the selected neuron identities to train hallucination classifiers on other factual question answering datasets.

Ali Derogar Odolou, Reza Nazari, Mostafa Salehi · 0 citations

#machine learning Preprint Sep 2026

Attention Dispersion as a Diagnostic Signal for Hallucination in Large Language Models

Large Language Models (LLMs) frequently exhibit hallucinations, presenting a major barrier to reliability in complex reasoning tasks. While traditional detection methods rely on output-based confidence metrics, these logits are often miscalibrated by modern alignment techniques. In this paper, we investigate the tempor...

S. More, Tanuja S. Pawar · 0 citations

#generative ai Review Open access Sep 2026

Systematically Reducing Hallucination in Generative AI from Users to Data to Models

AI hallucination is not just about a one-off technical glitch at the model level but is a systemic issue with the interplay between humans, the data, and the model itself. Most existing reviews focus on isolated parts of model development, like model architecture or data governance, and do not consider the whole model...

Jun-Hua Chen · Applied and Computational En... · 0 citations