Shubhanshu Shekhar

Efficient Sequential Evaluation of Large Language Models

This work invert a family of test supermartingales and proposes several mixture querying rules that combine growth-oriented querying, prediction refinement, and uniform exploration, trying to mitigate the effects that slow the shrinkage rate.