This work identifies a concrete failure of trace integrity in agent infrastructure which can be used to conceal misaligned behaviors like scheming or sabotage, and advises practitioners to ensure trace logging happens through an independent interception mechanism outside of the agent's control, preserving trace integri...
Jeremy Qin, David Schmotz, Derck W. E. Prinzhorn et al.· 0 citations
It is found that GPT-6 Astra's low evasion rate comes with overrefusal, as it frequently abandons otherwise solvable tasks under a denial-of-service prompt injection.
David Schmotz, Derck W. E. Prinzhorn, Luca Beurer-Kellner et al.· 1 citation
An architectural vulnerability is identified that circumvents anti-distillation mechanisms, allowing adversaries to extract a proprietary model's reasoning, as well as proposing concrete cryptographic and system-level mitigations to secure client-side reasoning.
Alexander Panfilov, David Schmotz, I. Shumailov et al.· 9 citations· ⚡3
ResearchArena is released as a modular framework for evaluating sabotage and control in automated AI R&D with ResearchArena, a framework spanning four long-horizon tasks: safety post-training, capabilities post-training, CUDA-kernel optimization, and inference-server optimization.
Lena Libon, Ben Rank, Jehyeok Yeon et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.