Chongye Wang

H2-LBM: A Hierarchical Hybrid Deep Reinforcement Learning Framework for L7 Load Balancing and Global Traffic Scheduling in Multi-Cloud LLM Serving

Experimental results consistently validate the effectiveness of H2-LBM in improving latency stability and system efficiency for large-scale LLM inference services.