Skip to content
Preprint

Tracekit: Tamper-Evident Intent-Reasoning-Action Auditing for AI Agents

Sep 2026 · 2 citations · 44 references
Computer Science

TL;DR

This work presents Tracekit (open source, MIT, version 1.4.1), which turns each agent run into evidence a third party can check offline, which turns each agent run into evidence a third party can check offline.

Abstract

AI agents run shell commands, edit repositories, send email and move money with their operators'credentials, yet the record of what they did is usually a log the agent, or whoever runs it, can edit. We present Tracekit (open source, MIT, version 1.4.1), which turns each agent run into evidence a third party can check offline. A signer that the agent cannot reach outside dev mode decides every tool call against its own policy before it runs, and signs the call, decision and result as Ed25519 records in a per-run hash chain inside an RFC 6962 Merkle tree whose checkpoints independent witnesses can cosign. A run exports as one .tkb bundle that two independent verifiers (Python, and TypeScript, also as a browser page) check against keys the verifier pins, reporting integrity and assurance separately. Disagreements between capture layers become signed records. Tracekit also records the person's request and what the model said before each call, holds calls that break a limit the request stated, compares what was asked, said and done, and finds which input caused an action by replay. Of 21 experiments: a signed log alone detects 6 of 8 tamper classes and a witness the other two; every insider attack in two suites is caught; the signer round trip is 0.45 ms median; no acknowledged record was lost in 60 kill -9 rounds; reconciliation flags 12 of 12 seeded discrepancies; the verifiers reject all 33 forgeries. Policy rules are a tripwire, not the boundary: they stop 570 of 570 harmful calls in our corpus but 211 of 420 (50.2%) written blind to them; the protection is a signer and credentials the agent cannot reach. On a held-out pool, a failed test claimed as passing is found in 86% of sessions with 5 false findings in 1,812 honest calls, and replay names the planted cause in 6 of 6 confirmed harmful runs with a 7B model.

View source

Similar papers

Review Sep 2026

Tracekit: Tamper-Evident Intent-Reasoning-Action Auditing for Autonomous Coding Agents

Tracekit is an open-source, dependency-free system that captures three channels for every agent session: what the human asked (intent), what the model said of its reasoning (self-report), and what it actually executed (actions).

Bravish Ghosh · 2 citations
#artificial intelligence Preprint Oct 2026

Approve What, Exactly? Effect Binding and Trusted Rendering for Agent Step-Up Authorization

AI agents now pause for approval before they send money, delete files or email outsiders, and that approval is usually treated as a second factor. We argue it is one only when compromising the agent cannot produce it and when it names exactly what it approves, and we test both conditions. We define twelve attacks on th...

Sai Varun Kodathala, Prashanth Pollishetty, J. Cargill · 2 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.