A methodology to systematically analyze and dissect existing approaches to define and enforce policy found in the wild is proposed to define and enforce policy found in the wild in GenAI applications.
Abstract
Generative AI (GenAI) applications have flourished enabling users to chat with large language models, and to create agents to act on their behalf for a variety of tasks. The pace of development of capabilities in this field is incredibly fast with security and safety taking a back seat. Unfortunately, the slower pace at which security and safety mechanisms have evolved has led to real incidents. Policy enables the definition of desirable behavior of applications, and for that reason, it is a cornerstone of making systems secure and compliant. Policy however means different things to different practitioners creating confusion and siloed solutions that are not adequate for compliance. This paper takes a tour of the good, the bad and the ugly when it comes to policy enforcement in GenAI applications. We propose a methodology to systematically analyze and dissect existing approaches to define and enforce policy found in the wild. Based on this principled analysis, we provide recommendations and call for action for the community to address. This paper is a companion extension of USENIX Security 2026 Enigma talk titled"From Alignment to Access Control: A Unified View of GenAI Policy Enforcement"by the author Nathalie Baracaldo.
Broken access control, the failure of authorization, is one of the most prevalent web security risks. Unlike injection, a flow of untrusted input into a dangerous operation, authorization is a relation: who may act on what, not how data moves. Each application decides that relation for itself, so no rule written in adv...
André V. Duarte, Aditya Oke, Me-Lo Rui et al.· 0 citations
The Actionable Policy schema is presented, a YAML-based format for specifying what model responses can and cannot contain that enables exception-based policy governance, and a set of tools to help define the schema and enforce policy.
Nathalie Baracaldo, N. Mello, Kush R. Varshney et al.· 0 citations
A language model agent acts through the tools it is given. The data it reads while working on a task can redirect what it does with those tools. A growing set of techniques for safe and secure agent execution therefore sits between the agent and its tools, aiming to enforce access control, information flow or isolation...
Reshabh K Sharma, Lin-Xi Jiang, Shuo Chen et al.· 0 citations
A2ABreak is presented, the first rigorous systematic security analysis of the A2A protocol, and introduces a novel framework that utilizes an LLM-assisted extraction of a verified finite-state machine directly from the natural-language specification.
Large language model agents are now privileged principals that take consequential actions: editing code repositories, operating inboxes, completing purchases. Their authority is kernel-grade, but it comes without what classical systems security requires: a trusted mediator interposed on every access. Operating-system v...
Recommendations for the design and deployment of secure LLM-enabled XR systems, emphasizing strategies such as security defense in depth, privacy-aware data practices, layered technical safeguards, continuous monitoring, and governance mechanisms that align security controls with the specific risks of immersive and int...
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
With $2.1 million funding from Google.org, the open-source Public Transit Intelligence Hub will unify public transit monitoring, operations, and passenger communication.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.