Conference
Open access
2026
InferenceDynamics: Adaptive LLM Routing through Structured Capability and Knowledge Profiling
This work proposes InferenceDynamics, a flexible and scalable multi-dimensional routing framework by modeling the capability and knowledge of models, and demonstrates its effectiveness and generalizability in group-level routing using modern benchmarks including MMLU-Pro, GPQA, BigGen-Bench, and LiveBench.
Haochen Shi, Tianshi ZHENG, Weiqi Wang et al.
· Annual Meeting of the Associ... · 0 citations