CruxBench: A Benchmark of Information Discovery
Benchmarks for large language models (LLMs) typically evaluate the accuracy of answers against fixed reference labels. But a central step in many complex real-world tasks is identifying which questions are worth asking in the first place: decomposing a difficult problem into subquestions -- which we call cruxes -- whos...
Hui Dai, Li-Na Piao, Nick Merrill et al.
· 0 citations