Skip to content

Social Laws for Multi-agent Coordination in Stochastic Environments

Sep 2026 · 1 citation · 22 references
Computer Science

TL;DR

The notion of $\alpha$-robustness, a measure of the guaranteed utility each agent retains while pursuing its optimal single agent policy, is introduced, assuming all agents obey the social law.

Abstract

In multi-agent environments, coordinating agents to prevent interference and ensure robust individual performance is a critical challenge. Previous research on social laws for multi-agent systems has primarily focused on deterministic, goal-based settings. This paper extends the concept of social laws to stochastic, reward-based environments, proposing a formalism for defining and verifying their robustness under various conditions. We introduce the notion of $\alpha$-robustness, a measure of the guaranteed utility each agent retains while pursuing its optimal single agent policy, assuming all agents obey the social law. We then present an approach for robustness verification of social laws in stochastic settings, based on a reduction to solving a series of Markov decision processes. Empirical evaluations on toy environments illustrate the potential of our framework.

View source

Similar papers

Open access Aug 2026

Ergodic control of multi-agent systems under communication constraints

We study decentralised ergodic control for multi-agent systems operating over stochastic, lossy communication graphs. Each agent follows controlled stochastic dynamics with uniformly elliptic noise on a compact domain and aims to align its occupation measure with a prescribed target distribution π. We separate two regi...

Ramen Ghosh · 1 citation
#artificial intelligence Preprint Sep 2026

Adaptive Agent Design

It is shown that a soft $Q$-learning algorithm converges almost surely to the fixed point of a soft Bellman equation defined by the stationary averages that the behavioral policy and the chosen kernel induce, and what separates the resulting policy from an optimal one.

R. K. Velicheti, Subhonmesh Bose, Tamer Başar · 0 citations
Conference Open access Sep 2026

Counterfactual Reasoning for Responsibility Attribution in Probabilistic Multi-Agent Systems

This work introduces a notion of retrospective (backward) counterfactual responsibility, which quantifies an agent's accountability for outcomes resulting from a given strategy profile, and demonstrates how to compute stable strategy profiles in which agents trade off responsibility against expected reward.

Chunyan Mu, Muhammad Najib · 0 citations
Conference Open access Sep 2026

Context-Aware Multi-Agent Coordination: Learning Correlated Equilibria Under Situational Constraints

This work introduces Situational-Constrained Correlated Policy Iteration (SC-CPI), a reinforcement learning algorithm employing a smooth Log-Sum-Exp mechanism for constraint optimization that is the first method learning CE under situational constraints.

Libo Zhang, Zhi-Rui Zeng, Yang Chen et al. · 0 citations
Conference Open access Sep 2026

Constant-Memory Strategies in Stochastic Games: A Theoretical and Empirical Study

This work comprehensively investigates the concept of constant-memory strategies in stochastic games, and uncovers the connection between decision models in single-agent and multi-agent contexts.

Feng-Ming Zhu, Fang-Zhen Lin · 0 citations
Preprint Aug 2026

Equilibrium in Multi-Agent Reinforcement Learning

Standard solution concepts for stochastic games, such as Markov perfect equilibrium and Markov coarse correlated equilibrium, are computationally difficult, and thus, standard decentralized reinforcement-learning algorithms should not generally be expected to converge to them. In this paper, we study the equilibrium ge...

Maurizio D'Andrea, Bar Light · 0 citations

Related blog posts

MIT News · Artificial Intelligence Sep 29, 2026

Who we become when we talk to machines

Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.