Sep 2026· Journal of engineering and applied sciences· Vol 73· 0 citations· 19 references
Microgrid Control and Optimization
TL;DR
This research enhances the interpretability of DRL policy evolution and provides a safety-aware and computationally efficient training framework with promising potential for future physical deployment, subject to further hardware-in-the-loop and on-site closed-loop validation.
Abstract
Microgrid energy management systems (EMS) require real-time, economically optimal, and safe dispatch strategies under high renewable uncertainty. While Deep Reinforcement Learning (DRL) offers promising online decision-making capabilities, standard DRL algorithms struggle with the “cold start” problem, slow convergence, and severe Sim-to-Real performance degradation when transferred from simulation to real-world operating conditions. To address these challenges, this paper proposes a novel Curriculum Learning-enhanced Proximal Policy Optimization (CL-PPO) framework for grid-connected microgrid energy management. By structuring a high-fidelity virtual environment into a three-stage progressive curriculum (Basic, Volatile, and Extreme), the agent systematically evolves from learning fundamental arbitrage rules to mastering robust dispatch under severe boundary conditions. Experimental results demonstrate that curriculum-guided knowledge transfer reduces the required convergence steps by approximately 38% compared with Baseline PPO. In typical-scenario evaluations, CL-PPO reduces daily operating costs by 7.1% relative to Baseline PPO and achieves a near-optimal 2.4% economic gap relative to the non-causal Mixed-Integer Linear Programming (MILP) oracle, requiring only 12.5 milliseconds per inference. Furthermore, an offline Sim-to-Real replay evaluation was conducted using approximately 90,000 previously unseen operational records from a real-world campus microgrid. In a replay environment parameterized according to the target microgrid’s energy-storage-system characteristics, CL-PPO demonstrated strong cross-domain robustness against measurement noise and operational disturbances, achieving an average total constraint violation rate of 1.2%. No policy-generated command was applied to the physical microgrid during this evaluation. Ultimately, this research enhances the interpretability of DRL policy evolution and provides a safety-aware and computationally efficient training framework with promising potential for future physical deployment, subject to further hardware-in-the-loop and on-site closed-loop validation. A curriculum learning-enhanced PPO (CL-PPO) framework is proposed for safety-aware and computationally efficient energy management in grid-connected microgrids. A dual-condition transition criterion jointly evaluates reward and safety violation rate to guide curriculum progression. A decoupled reward function separates economic incentives from safety-boundary penalties, improving policy interpretability. CL-PPO reduces the required convergence steps by approximately 38% and narrows the economic gap relative to the MILP oracle to only 2.4%. Offline Sim-to-Real replay evaluation using approximately 90,000 unseen real-world operational records demonstrates strong cross-domain robustness, with an average total constraint violation rate of 1.2%.
The increasing integration of renewable energy and energy storage systems presents challenges for microgrid scheduling under uncertain operating conditions and multiple operational constraints. Conventional reinforcement learning methods may generate infeasible actions, while direct safety clipping can create inconsist...
Jiang-Nan Li, Ji-Ru Jiang, Ming-Yu Ou et al.· Electronics· 0 citations
This paper proposes a soft actor-critic (SAC)-based EMS algorithm for a grid-connected microgrid with photovoltaic generation, a microturbine, and a BESS modeled with nonlinear charging and discharging losses and cyclic degradation, and introduces a reward formulation that excludes the action-independent term to reduce...
The transformations of traditional electricity distribution into decentralized, dynamic microgrids have been rapid through the proliferation of electric vehicles and distributed renewable power generation technologies. This transformation creates challenges for managing EV-based microgrids with real-time energy managem...
R. P· International Journal of Dig...· 0 citations
Microgrid energy management must reconcile economic operation with operational resilience under supply-loss contingencies and power fluctuations. Economically efficient schedules may leave insufficient dynamic capability to contain severe frequency excursions following emergency islanding or generator trips. This paper...
Shu-Shan Qiu, K. Rajashekara· Energies· 0 citations
Ensuring demands are satisfied while minimizing operating costs remains a challenging problem for reinforcement learning (RL), particularly in long-horizon energy management settings. In this work, we propose a unified training framework that combines curriculum learning with a threshold-gated reward mechanism for sequ...
Rural microgrids incorporating solar, wind, and battery storage frequently rely on rigid, rule-based edge controllers for energy distribution. These static IF/THEN systems react only to immediate electrical states and fail to anticipate upcoming meteorological changes, leading to suboptimal energy routing and accelerat...
A. Sharma, J. Petau, R. Jayaramu et al.· Book of Abstracts of the 2nd...· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduNov 17, 2026
By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.
MIT News · Artificial Intelligence· news.mit.eduNov 17, 2026
AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduNov 9, 2026