Large language models (LLMs) are increasingly used as costly, on-demand components in real systems, but calling them indiscriminately can waste substantial compute, latency, and serving budget. The key deployment question is therefore not only whether an LLM helps on average, but when it is worth calling. We identify a...
Ying Yuan, Yu Wang, Yize Cheng et al.· 0 citations
Hierarchical reinforcement learning improves long-horizon control by organizing primitive actions around persistent subgoals and assigning credit at multiple temporal scales. Recent hierarchical language agents bring these benefits to interactive tasks by explicitly separating subgoal planning from action execution. We...
An exam-style evaluation framework is introduced for studying the global budget allocation of reasoning language models when multiple problems share an end-to-end cost or latency constraint, in which a model must distribute one shared token budget across questions with different difficulty and point values.
Chenrui Fan, Yize Cheng, Ming Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.