HARDEN: Constrained Evolutionary Search for Harder, Answer-Preserving Evaluation Cases
Language models are often evaluated on curated benchmarks that underrepresent the complexity of enterprise deployments. We introduce HARDEN, a constrained evolutionary search method to adapt the input of existing evaluation cases into more challenging variants while keeping their expected outputs fixed. HARDEN searches...
Aditya Kumaran, Rahul Singhal, Karime Maamari et al.
· 0 citations