Because the signal spans a contiguous layer band, LayerMix aggregates it to match oracle-layer performance without oracle access, and characterize the geometry within the controlled paired-example paradigm.
Abstract
Hidden-state probes effectively detect LLM hallucinations, but the geometry of the signal remains poorly characterized, driving increasingly complex probe architectures. Across three 7B-scale models and three datasets in a paired-example paradigm, we find the signal overwhelmingly dominated by a single mean-shift component, and removing this direction collapses detection to chance. Shrinkage linear discriminant analysis closes about 73% of the gap between 1D and full-dimensional classifiers, so apparent architectural complexity largely reflects high-dimensional covariance estimation difficulty rather than exploitable non-linearity. A simple L2-regularized logistic regression (0.952 AUROC) bounds or outperforms twelve controlled architectural alternatives, and our multi-layer aggregation exceeds CLAP cross-layer attention probing under matched paradigm. Because the signal spans a contiguous layer band, LayerMix aggregates it to match oracle-layer performance without oracle access. Our claims characterize the geometry within the controlled paired-example paradigm. Our code is available at https://github.com/js-lee-AI/LayerMix.
HalluTracer is introduced, a detection framework that reads and aggregates truthfulness evidence across every layer of the forward pass before the model emits any answer token, recasts hallucination detection from a layer-selection problem into a depth-aggregation problem governed by the geometric sparsity of the truth...
Zhi-Hao Guo, Zong-Han Wu, Huan Huo et al.· 0 citations
This work proposes a five-step diagnostic protocol covering feature correlation, bootstrap stability, sparse versus dense ranking disagreement, intervention baselines, and cross-dataset evaluation as a minimum standard for sparse-neuron localization claims, and investigates prior work using the proposed approach.
Huseyin Cavus, Sebin Sabu, J. Spear et al.· arXiv.org· 0 citations
These findings show that aggregate detection metrics conceal persistent, model dependent heterogeneity in language model failures and motivate regime conditioned evaluation.
P. Darshan, A. Pranav, T. SravanKarthick et al.· arXiv.org· 0 citations
It is found that the hallucination signal survives code-mixing well: transfer AUROC ranges from 0.88 to 0.99, with gaps of mostly under 0.05 AUROC relative to in-distribution performance, and that Hindi-trained probes transfer to Hinglish more reliably than English-trained probes.
It is shown that epistemic uncertainty leaves a measurable trace within intermediate layers, where spikes in attention entropy are associated with reasoning breakdowns, and that attention dispersion is a promising complement to traditional hallucination detection methods.
InnerExpert is introduced, the first method to leverage MoE-specific signals for per-token hallucination detection, and shows that InnerExpert outperforms existing methods across five datasets and two MoE architectures.
João Fonseca, Rodrigo Rodrigues, Paolo Romano· 0 citations
By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.