Preprint
Sep 2026
Replacing Large Language Models with Jev Decision Models for Low-Latency Edge Service Orchestration
Natural-language service requests can require a language-model decision before execution starts, consuming part of the request's latency budget. We integrate Jev's decision-oriented application programming interface (API) into edge service orchestration to reduce this overhead while retaining service completion. The in...
De-Long Li, Xu Wang, Hao-Chen Gong et al.
· 2 citations
· ⚡1