An end-to-end Predict-Then-Schedule (PTS) framework that integrates upstream workload prediction with downstream scheduling optimization and maps input features directly to optimal scheduling and enables gradient-based training is proposed.
Abstract
The surge of GPU-intensive workloads in artificial intelligence (AI) data centers drives massive energy demands, leading to soaring costs and significant stress on local power distribution networks. Coordinating delay-tolerant workload scheduling with power grid conditions via precise workload prediction can mitigate these issues. However, a critical gap remains in conventional approaches, i.e., minimizing prediction error does not necessarily lead to minimized downstream operational loss. Hence, this paper proposes an end-to-end Predict-Then-Schedule (PTS) framework that integrates upstream workload prediction with downstream scheduling optimization. By leveraging differentiable convex optimization, the PTS framework maps input features directly to optimal scheduling and enables gradient-based training. Furthermore, to respect the data center's capacity, a workload over-shifted loss combining electricity cost with a penalty for load-shedding is introduced to evaluate scheduling quality. Experiments demonstrate that the proposed framework significantly reduces operational cost and enhances system security compared to the conventional two-stage baseline.
RAPID is proposed, a region-aware and power-informed scheduling framework that integrates static and online heuristic schedulers for large-scale AI request scheduling that significantly reduces carbon emissions, electricity costs, and total energy consumption.
B. Ding, Cai-Ning Wang, Ka-Fei Tang et al.· Sustainability· 0 citations
A carbon-aware co-optimization framework that schedules checkpoint intervals, workload migration, dynamic voltage and frequency scaling, and behind-the-meter storage jointly with unit commitment, pricing system CO2 emissions beyond the market-internalized level, with split-conformal scenario bands and an out-of-sample...
Jun-Qing Zhang, Yi Wang· Sustainability· 0 citations
This work introduces a novel LLM-based predictive scheduling system designed to enhance operational efficiency while reducing the environmental impact of data centers, using an LLM to predict key metrics such as execution time and energy consumption from source code.
Hanzhao Wang, Jingxuan Wu, Yumeng Li et al.· 0 citations
As AI training moves toward geo-distributed elastic infrastructures, its bottlenecks extend beyond GPU availability to variable energy and network conditions. The key challenge is translating heterogeneous placement, scaling, congestion, and training-stage effects into useful progress. We propose Effective Compute Util...
Yu-Xin Chen, Zhu-Zhong Qian, Lin Qian et al.· Fall Joint Computer Conferen...· 0 citations
PowerAtlas is presented, an LLM-agent framework for electricity-computing co-scheduling that integrates historical instances, domain knowledge, and physical constraints to produce joint decisions satisfying both grid operational rules and the service-level agreements of computing tasks.
Model commitment (MC) is proposed, a mixed-integer linear programming framework that jointly schedules model deployment and cross-site request routing under power constraints and electricity-price signals and enables AI data center operators to achieve a 100% service rate under time-varying grid conditions and reduce t...
Bo-Jun Du, Hong-Yang Jia, Tong-Hui Li et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.