SpeedrunBench: Challenging LLM Agents with Video Game Speedrunning
The results suggest that SPEEDRUNBENCH is a useful testbed for studying agents's strategy formation capabilities as well as being a saturation-resistant evaluation measure, as there is almost always a faster completion time waiting to be discovered.
Yoshinari Fujinuma, Keisuke Kamahori, Ryuto Koike et al.
· 0 citations