SABER-Math: Automated Benchmark for Information Retrieval Evaluation in Mathematics
SABER-Math is introduced, the first fully automated benchmark for evaluating mathematical IR without expert annotation, and it is shown that general-purpose IR benchmarks such as MTEB do not reliably predict mathematical performance, especially for recent embedding models, highlighting the need for math-specific retrie...