Measuring Cross-Task Behavioral Consistency in Language Model Agents
It is found that consistency is not reducible to success rate, since systems with comparable success can differ sharply in consistency, and that the frontier-versus-open-source consistency gap persists under a within-task control that holds task difficulty constant.