Can Agents Deceive? Evaluating Reasoning and Deception in ParliamentBench using a Social Deduction Game
This work presents the open-source benchmark framework ParliamentBench based on the game Secret Hitler to evaluate LLMs in scenarios that require deception, persuasion, and reasoning under information asymmetry, and introduces three novel metrics that isolate social deduction, reasoning, and deceptive consistency.