How Good Are Frontier Models at Physics? Expert Re-Grading Reveals Broken Evaluations and Near-Saturation of Leading Benchmarks
Evaluating frontier models on six widely used physics benchmarks and auditing them with experts suggests that current benchmarks substantially understate frontier models'ability to solve well-posed physics problems.
Ali Ansari, Hao-Ran Sun, Andy Zeyi Liu et al.
· 0 citations