V VERA-8B is a new end-to-end audit reasoning system that identifies audit risks before enforcement actions occur, and is the first to unify SFT and GRPO for evidence-grounded audit reasoning under one evidence standard.
Abstract
Across audit applications, judgments must be supported by reasonable evidence. However, standard financial language models prioritize fluency over evidence. They are built for general financial reasoning and may produce plausible but ambiguous answers, creating a grounding gap that makes them unsuitable for audit work. We address this gap with VERA-8B, a new end-to-end audit reasoning system that identifies audit risks before enforcement actions occur. Constructing such a model raises several challenges, as no prior machine learning work targets pre-enforcement audit prediction. To our knowledge, we are the first to unify SFT and GRPO for evidence-grounded audit reasoning under one evidence standard, achieving performance that surpasses all evaluated baselines. Because auditing cannot tolerate unsupported claims, we introduce abstention and uncertainty qualification to defer uncertain or evidence-incomplete cases. Finally, we design an AuditBridge to ground model reasoning for practical audit work. It transforms raw filings into verified records and then into reviewer-ready reports, bridging finance and computation with broad generality. Together, these components produce auditable, review-ready outputs suitable for practical audit work.
The evaluation shows that IntelliAudit can support control interpretation, evidence-grounded reasoning, and audit-preparation workflows, while also revealing the importance of human oversight for calibrating sufficiency judgments and correcting overly permissive recommendations.
Allison Wilson, S. Sabet, Diar Shakimov et al.· 0 citations
Experiments demonstrate that Code-as-Auditor delivers more accurate and evidence-backed evaluations, enabling automated compliance regulation checking grounded in explicit regulatory criteria and improves the logical consistency of the generated code and the traceability of outcomes.
Jisoo Kim, Taeyoon Kwack, Jin-Woo Jang et al.· 1 citation
Tool-using LLM agents increasingly produce financial artifacts such as ratio tables, evidence-backed memos, and spreadsheet-style analyses. Existing evaluations often reduce such outputs to binary correctness or faithfulness labels, overlooking whether the artifact has sufficient evidence, whether errors are material o...
Jia-Wei Li· Proceedings of the 2026 ACM...· 0 citations
Probity, a benchmark of 60 tasks and 470 items from real venture-financing filings, is built and a defect any excerpt-built benchmark can carry is found: items whose evidence is missing from the window of text the model is shown.
Large language models are often asked which input factors influenced their outputs. For structured inputs, such reports can be checked by counterfactual perturbation, but each factor must be queried multiple times to estimate its effect, so verification is usually budget-limited. We study how this limited-budget settin...
Tao-Lin Zhang, Han-Yu Wang, Jiu-Heng Wan et al.· 0 citations
Difference-in-differences (DID) studies are widely used to evaluate climate policy, but assessing the evidence supporting their identification assumptions remains challenging. We introduce ARGUS, a structured language-model pipeline that audits reported evidence against an eleven-dimension assumption-implication-eviden...
Yong-Hong Zhang, Yong Xie, Isabel M. Parra et al.· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
With $2.1 million funding from Google.org, the open-source Public Transit Intelligence Hub will unify public transit monitoring, operations, and passenger communication.