Skip to content

CoTu at EXACT 2026: Neuro-Symbolic Reasoning for Transparent Educational QA

Jul 2026 · arXiv.org · Vol abs/2607.14735 · 0 citations · 33 references
Computer Science

TL;DR

A neuro-symbolic Program-of-Thought pipeline in which a 4B backbone writes a program rather than stating an answer directly, which yields correct, verifiable deductions at the 4B scale, and the residual difficulty lies in premise selection rather than the deduction itself.

Abstract

Transparent educational question answering asks for answers that are not only correct but explainable, and doing so with small models rules out the reasoning power of the largest proprietary systems. The EXACT 2026 competition poses this problem concretely: open-weight language models of at most 8B parameters, self-hosted, with a natural-language explanation for every answer. It pairs two tasks: logical reasoning over university regulations, and multi-step physics problem solving. We describe the system that team \cotu{} developed to address both, a neuro-symbolic Program-of-Thought pipeline in which a 4B backbone writes a program rather than stating an answer directly: for regulation queries it emits a Z3 encoding whose entailment verdict grounds the deduction, and for physics it emits numerical Python, both wrapped in a shared self-correction loop and a unified explained-JSON output. Answer-type routing, distillation-based task fine-tuning, and a latency-aware serving stack -- SGLang with speculative decoding -- keep the system within the 60-second per-query limit. The system achieved a \textbf{perfect score} on the physics task in both automated selection rounds and obtained the \textbf{highest final-round technical score} of any team -- $13.44/15$, combining automated answer evaluation with expert-judged reasoning depth -- with the equally weighted presentation score included, \cotu{} placed 3rd overall. Grounding answers in a symbolic solver yields correct, verifiable deductions at the 4B scale, and the residual difficulty lies in premise selection rather than the deduction itself.

View source

Similar papers

Preprint Aug 2026

Shorter Reasoning, Earlier Answers? An Evaluation of Reasoning Interfaces

Paired runs of the same question at matched reasoning horizons across 198 GPQA Diamond and 500 MMLU-Pro questions are evaluated, finding that a tight deadline can favor lower effort or a concise instruction, whereas allowing high effort to finish can recover higher final accuracy.

Francesca Carlon, Vincent Ginis, A. Algaba · 0 citations
Jul 2026

Reason Popper-ly: Patching In-Context Reasoning with Inductive Logic Programming

Reason Popper-ly, a neurosymbolic framework that uses inductive logic programming (ILP) to learn relation composition rules from reasoning traces and deploys them as an online verifier for step-level correction, consistently improves terminal accuracy over standard CoT.

Zi-Rong Chen, Mei-Yi Ma · 0 citations
Book Open access Aug 2026

SymDiag: Explainable Diagnosis for LLM Reasoning via Neuro-Symbolic Verification

SymDiag is proposed, a neuro-symbolic framework that reframes reasoning verification as structured failure diagnosis and incorporates a Self-Auditor that disentangles TranslationError from ReasoningError via dual symbolic encodings consistency checks, enabling robust diagnosis under partial observability.

Wenyao Cui, Hua-Ping Zhang, Yongyi Huang et al. · 0 citations
Preprint Aug 2026

NeSy-RAG: Neuro-Symbolic RAG for Explainable Question Answering

This work proposes NeSy-RAG, a modular neuro-symbolic RAG framework that synthesizes attributable Prolog modules from retrieved text chunks that introduces a symbolic knowledge-gap detection mechanism that identifies missing user facts whose truth values affect the query outcome and automatically triggers follow-up int...

Jonas Gann, Michael Gertz · 1 citation
Conference Open access Sep 2026

Neuro-Symbolic Logical Reasoning with Textual Entailment

This paper adapts VANESSA, a neuro-symbolic method for chain-of-thought verification, to reasoning-based question answering, and develops a transparent, logic-based approach to answer natural language questions even with phrase variations.

Zacchary Sadeddine, Fabian M. Suchanek · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.