2026· International Journal of Scientific Research and Management· 1 citation
TL;DR
This paper synthesizes the findings of the five-paper AI Agent Security Series into a unified, formal, and falsifiable theory of autonomous agent security, and establishes three meta-theorems: the Component Insufficiency Theorem, the Dynamic Necessity Theorem, and the Interaction Irreducibility Theorem.
Abstract
Security in autonomous AI systems is not a property of individual components such as identity verification, static policy configurations, or model-level safeguards. Instead, it is a dynamic system property emerging from three interconnected dimensions: intent, time, and interaction. Intent captures the alignment between an operator’s goals and an agent’s behavior; time reflects the evolution of security states under adversarial pressure; and interaction describes how trust relationships between agents can propagate misalignment. This paper synthesizes the findings of the five-paper AI Agent Security Series into a unified, formal, and falsifiable theory of autonomous agent security. Current AI security approaches focus on component-level controls, including authentication, policy enforcement, and output filtering. However, results from Papers 1–5 show that these mechanisms are individually insufficient and collectively vulnerable to clean attacks semantically valid, policy-compliant adversarial inputs that redirect agent behavior while evading existing detection methods. We argue that such failures are structurally inevitable under component-centric security models. To address this gap, we introduce the Unified Security Function, Φ_security(φ, t, G), a scalar measure in the range [0,1] that combines IntentAlign, TemporalStability, and NetworkIntegrity into a single dynamic assessment of security health. Using this framework, we establish three meta-theorems: the Component Insufficiency Theorem, the Dynamic Necessity Theorem, and the Interaction Irreducibility Theorem. Evaluation on the complete AegisBench benchmark suite (1,560 sessions across Papers 1–5) shows that Φ_security predicts attack success with an AUC of 0.943, outperforming all individual metrics. By defining autonomous agent security as a distinct scientific object, this work provides a foundational framework for future research on secure and adaptive AI systems.
A formal framework for security in agentic AI is developed, built around an ideal predicate ϕ that decides, for a given ( prompt, context, result ) triple, whether the agent’s behaviour is acceptable.
F. Durak, Tadayoshi Kohno, Franziska Roesner· 0 citations
A governance and security-by-design framework that embeds responsibility mechanisms directly into agentic AI architectures, enabling continuous self-monitoring and alignment verification through multi-agent governance systems.
Himanshu Joshi, Shivani Shukla· Proceedings of IASEAI Confer...· 0 citations
This work systematizes MAS security through an execution-centered analysis of 197 works, introducing an A-I-R framework that organizes attacks by adversary position, interaction interface, and resulting system-level risk, unifying otherwise fragmented attack mechanisms across MAS.
Rui Yang, Jun-Jie Xu, Zheng-Yu Liu et al.· 1 citation
Open Security Benchmark is presented, a framework that benchmarks agentic AI on security posture management work and surfaces a curated enterprise environment that evaluates posture investigation across two modalities: text-to-SQL over a relational snapshot and each vendor's native API over a served instance of the sam...
Gal Engelberg, Michael Arenzon, Leon Goldberg· arXiv.org· 0 citations
Cyber-capable AI agents combine language models with tools, memory, and execution environments to perform multi-step offensive-security tasks. Existing work separately measures cyber capability and catalogs attacks against agent components, but provides less guidance on containing a capable agent within the environment...
This work presents a trust-boundary-centric survey of foundation-model-powered embodied-agent security, and shows that attack research is concentrated on multimodal perception and action interfaces, while defenses are especially concentrated on action-level and runtime protection.
Jia-Wei Liu, Jia-Cheng Guo, Tian Zhang et al.· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduSep 30, 2026
Able to defeat top-ranked human players and more efficient than other models, the new system could help decision-makers in military maneuvers or business negotiations.
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.