Response-Informed Value Estimation for Cost-Aware Multi-Turn LLM Routing
RIVET jointly trains two value estimators over a shared state-model representation: a deployable Routing Value Estimator that scores candidate models from pre-call information, and a training-only Response-Informed Value Estimator that additionally observes the realized response.
Hao-Tian Yan, Jia-Qi Liu, Bing-Yi Jing et al.
· 0 citations