The findings of MaSCoD support structural pre-organization as an explicit design and evaluation target for omission control and motivate evaluating context construction jointly with its utilization in judgment.
Abstract
Large language models (LLMs) have been applied to causal discovery, but candidate-graph generation rarely treats premature omission of potentially relevant causal relations as an explicit design objective. We propose MaSCoD, a multi-agent framework that organizes candidate third variables and local structural patterns before direct-edge judgment. We evaluate MaSCoD on Auto-MPG, DWD, and Sachs using GPT-5.4 as the primary backbone and GPT-4o for replication. MaSCoD exhibits a dataset- and backbone-dependent retention-selectivity profile rather than uniform superiority. Across all six dataset-backbone settings, Full, which supplies structural hypotheses before direct-edge judgment, achieved higher mean Recall and F1 than No Phase 1, which instead constructs them within the judgment procedure, while also increasing false-positive rates. Additional reference-edge retention over all evaluated baselines was observed on DWD with GPT-5.4 and on Sachs with GPT-4o, rather than uniformly across settings. Partial ablations showed that supplying both information components did not always outperform supplying only one. For GPT-5.4, stage-wise analysis showed that the Full-No Phase 1 retention gap was already present after direct-edge judgment, while reconciliation introduced additional reference-edge loss for Full on Sachs. These findings support structural pre-organization as an explicit design and evaluation target for omission control and motivate evaluating context construction jointly with its utilization in judgment.
Multi-modal Knowledge Graphs (MMKGs) provide a natural substrate for knowledge-intensive question answering because they connect structured relational facts with entity-centered visual evidence. Recent LLM-based reasoning methods have improved multi-hop exploration over knowledge graphs, but extending them to MMKGs rem...
Yi Yan, Zhe Xue, Su Li et al.· Proceedings of the 1st Inter...· 0 citations
AgentHop, a diagnostic benchmark of 1,011 multiple-choice questions paired with a controlled seven-tool sandbox under fixed token, turn, and tool-call constraints, and the full benchmark set and the harness are released to support diagnostic agent benchmarking.
Chanhee Park, Jeongho Yoon, Sung-Bin Han et al.· arXiv.org· 0 citations
Behavioral consistency across repeated executions provides an informative signal for assessing the reliability of large language model (LLM) agents. However, existing approaches typically summarize consistency with a single task-level score, without identifying where behavioral differences occur or whether actions are...
Ya-Xin Ma, Wen-Bo Zhang, Satya K. Pothapragada et al.· 0 citations
Patients with rare diseases often wait years for a diagnosis. Existing HPO-based retrieval tools narrow the differential to a shortlist, but a clinician reading that shortlist has no signal for which candidate to trust or what to test next. We present CausalOdyssey, a local four-agent pipeline on Gemma 4 26B built over...
As agents evolve from single-tool systems into modular, composite architectures, skills are becoming an important mechanism for capability development and distribution. However, the academic community lacks a structured framework for systematically analyzing and evaluating skills. Drawing on information gain and behavi...
Zong-Rui Yang, Xin-Tong Li, Run-Chen Xu et al.· 0 citations