The Evidence Package Benchmark is introduced, integrating 1,870 packages across six heterogeneous sources with explicit modality masks and evidence permissions, and EviBound, a protocol-aware evidence control framework is proposed, a protocol-aware evidence control framework for safer clinical NLP research.
Abstract
Computational mental health screening using multimodal speech and text has shown great promise. However, existing models often assume all clinical speech protocols carry equivalent evidentiary validity. In reality, heterogeneous protocols, from free interviews to fixed reading tasks, support fundamentally different evidence. Forcing uniform reasoning flattens these boundaries, causing models to hallucinate symptoms from irrelevant text or overclaim support. Even advanced long chain-of-thought LLMs fail to resolve this issue, as free-form reasoning can exacerbate boundary violations. To address this, we reformulate multimodal screening as an evidence-bounded reasoning problem. We introduce the Evidence Package Benchmark, integrating 1,870 packages across six heterogeneous sources with explicit modality masks and evidence permissions. We further propose EviBound, a protocol-aware evidence control framework. Unlike direct LLM prompting, EviBound uses a profile-aware planner to restrict reasoning scope, orchestrates evidence tools via five-way acoustic consensus, and enforces a boundary critic to suppress unsupported claims. Empirical results show EviBound achieves a held-out test Depression AUROC of 0.8658, exceeding the strongest direct omni-modal baseline by +0.0811 AUROC while maintaining zero claim violations. Our work moves beyond unconstrained accuracy toward evidence-consistent, protocol-aware systems for safer clinical NLP research.
This work proposes MRER (multi-agent reasoning with evidence retrieval), a multi-agent retrieval and reasoning framework inspired by evidence-based medicine that achieves an average accuracy and improves the logical coherence and trustworthiness of the generated reasoning.
A scalable framework that identifies text-biased surface interpretations and converts disagreement regions into conflict QA examples and develops an agentic-style reasoning framework that converts speech into an Audio Twin, a text-readable representation of localized acoustic cues that exposes acoustic evidence to the...
Yen-Ju Lu, Yu-Zhe Wang, Yao-Han Guan et al.· 1 citation
A Temporally-Aligned, Missingness-Aware, Interpretable (TAMI) multimodal fusion framework that aligns speech, language, facial, and physiological features within question-answer segments on a shared timeline, encodes modality-level missingness over time, and conditions fusion on question context is proposed.
M. Bibars, Bolaji Omofojoye, A. Levey et al.· 0 citations
This work proposes ARIA-Rubrics (Audio Reasoning Integrity Assessment), a lightweight, annotation-free gold reasoning chains, automatic and transparent framework comprising six complementary metrics that evaluate audio reasoning quality across perceptual grounding, reasoning coherence, and answer consistency.
Yu-Pei Li, Qi-Yang Sun, Mohamed Mady et al.· 0 citations
This work highlights the need to audit feature transferability and report worst-case domain robustness in cognitive speech screening by proposing a fusion method that integrates XLM-R text baseline scores with evidence anchors selected during training.
Zi-Jian Lu, Si-Zhe Liu, Yin Zhang et al.· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 15, 2026
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduSep 24, 2026