Reproducible Evaluation as the Substrate for Safe Prompt Compression in Production Agents
This work presents an offline evaluation harness for a production conversational agent that stays reproducible despite the live data it operates on changing, and that can be regenerated on demand once it goes stale.
Prabal Vashisht, Zheng Hu, Ying Yang
· 0 citations