Skip to content
Preprint

Semantic Cooperative Games for Contribution Attribution in LLM-Based Multi-Agent Systems

May 2026 · 0 citations · 47 references
Computer Science

TL;DR

The Semantic Shapley Value (SSV) is defined to allocate contribution over semantic support logic, and SLIC is introduced, a single-trajectory algorithm that constructs the semantic hypergraph, recovers minimal semantic supports, applies Boolean absorption, and computes SSV without rerunning agent subsets.

Abstract

Contribution attribution has become a central problem in LLM-based multi-agent systems, where final outputs are produced through multiple agents, message exchanges, and ordered workflow dependencies. Existing attribution methods often rely on counterfactual valuation, such as removing agents or comparing score changes across altered agent subsets. In language-mediated workflows, these methods require repeated model calls, introduce high variance, and do not explicitly capture the intermediate semantic states through which agents produce, preserve, and transform task-relevant information. We propose Semantic Cooperative Games (SCG), a framework that represents a realized language flow as a semantic generation hypergraph and induces an agent-level semantic value function on this structure. We define the Semantic Shapley Value (SSV) to allocate contribution over semantic support logic, and introduce SLIC, a single-trajectory algorithm that constructs the semantic hypergraph, recovers minimal semantic supports, applies Boolean absorption, and computes SSV without rerunning agent subsets. We prove that SSV reduces to the classical Shapley value under standard set-based, fully observable, and no-order-dependence conditions. On a medical benchmark satisfying these conditions, SLIC reduces computation cost by 93.3% while remaining highly consistent with a Monte Carlo Shapley baseline. In more general multi-role workflows, SSV aligns with perturbation-induced score-drop profiles and exposes cases where semantic contribution and failure impact diverge. Overall, SLIC provides a fast, counterfactual-free, and interpretable attribution method for complex LLM-based multi-agent systems.

View source

Similar papers

Preprint Aug 2026

Semantic Uncertainty-Guided Orchestration in Hierarchical Multi-Agent Systems

A semantic-uncertainty-guided orchestration approach, HASSUM is introduced as a general framework for uncertainty-aware coordination in multi-agent systems and suggests that semantic uncertainty is a practical and general-purpose signal for improving robustness and trustworthiness in agentic AI systems.

John Knowlton, Aritra Guha, Risto Miikkulainen · 0 citations
Preprint Aug 2026

ForestBench: A Unified Graph Framework for Evaluating Multi-Agent Collaboration

This work introduces a generalizable evaluation framework that maps native MAS traces into a shared space of unified collaboration graphs, enabling different methods to be evaluated under the same representation, reference set, and metric panel.

Guo Chen, Ziwen Li, Reed Li et al. · 0 citations
Preprint Aug 2026

ASCon: A Direction-Aware Reciprocal Agent--Step Contextualization Model for Failure Attribution in Multi-Agent Systems

ASCon is proposed, a direction-aware reciprocal \textbf{A}gent--\textbf{S}tep \textbf{Con}textualization model for multiple failure attribution targets that introduces direction-aware graph attention to model execution context, masked step-to-agent attention to construct behavior-aware agent representations, and agent-...

Shu-Yu Jiang, Yue Ran, Kaiyu Xu et al. · 0 citations
Conference Jul 2026

Metamorphic Testing of Multi-Agent LLM Systems: A Trace-Based Behavioral Oracle Framework

Multi-agent systems built on large language models (LLMs) are increasingly deployed for complex tasks requiring autonomous planning, tool use, and inter-agent coordination. However, the non-deterministic nature of LLM outputs and the emergent behavior arising from agent interactions render traditional test oracles inef...

Gopalakrishnan Marimuthu · 0 citations
Open access 2026

Agentic GraphRAG and Deterministic Schema Reconciliation for High-Compliance Domains: An LLMOps and FinOps Approach

A scalable Agentic GraphRAG architecture structured under a comprehensive LLMOps Feature-Extraction-Inference (FTI) lifecycle, which achieves a 70% improvement in Citation Rate compared to standard Vector RAG and establishes a robust Safe Abstention rate, effectively mitigating the risk of ungrounded generation.

Marcelo Massashi Simonae, A. Ortoncelli, Marlon Marcon · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.