Differentiable market clearing turns market-aware planning into a problem gradients can search: each forward pass solves the market, and reverse-mode automatic differentiation propagates the planning cost back through the cleared prices to the plan.
Abstract
Planning a large data center is difficult because a facility big enough to matter changes the electricity prices it will pay. Those prices are set by market clearing, a constrained optimization problem solved anew in every operating condition. However, simulating the market tells a planner how a candidate plan performs but not how to improve it. Here we treat market clearing as a differentiable optimization layer: each forward pass solves the market, and reverse-mode automatic differentiation propagates the planning cost back through the cleared prices to the plan. After validating these gradients against finite differences, we apply them to a concrete problem: allocating 50 MW of data-center load across six candidate buses in two synthetic networks, under a fixed cost per active site, evaluated over 36 operating states. Judged against exhaustive enumeration of all site combinations, gradient optimization recovers the continuous allocations almost exactly, with worst-case objective gaps of 2.3\% and 8.5\% of the cost difference between the best and worst single site. Its one systematic error is instructive: near the costs at which a site should close, the smooth relaxation of the discrete site count shrinks the site rather than closing it, so discrete transitions arrive late. Differentiable market clearing thus turns market-aware planning into a problem gradients can search.
Transmission expansion planning (TEP) for renewable-rich power systems requires a computational workflow that links investment decisions with chronological operations and nodal economic signals. This study presents a shadow price-guided framework integrating hourly DC optimal power flow, multi-hour candidate screening,...
Recent efforts to decarbonize power systems have led to the development of carbon-aware optimal dispatch models. Existing approaches typically focus on modeling either the distribution or the transmission system, disregarding the effects of their operation decisions on each other. Nonetheless, there are a few attempts...
W. Faria, Gregorio Muñoz-Delgado, Javier Contreras et al.· 2026 International Conferenc...· 0 citations
In power markets where the physics of the transmission grid is closely represented in market clearing models, certain cross-zonal power exchanges can take place only if other exchanges occur concurrently. This leads to challenges in cross-zonal balancing capacity markets, where the activation of reserves in real time r...
M. Madani, Zejun Ruan, Anthony Papavasiliou· 0 citations
In a network with ramp-limited generators and inaccurate net-demand forecasts, practical rolling-window dispatch can drive locational marginal prices (LMPs) below generators'bid-in offers. In such cases, out-of-market (OOM) settlements are used to compensate generators and maintain dispatch-following incentives, but OO...
Valentina Norambuena-Guzmán, Cong Chen, Tong Lang et al.· 0 citations
This study proposes an optimal bidding path construction framework based on the Deep Deterministic Policy Gradient (DDPG) reinforcement learning algorithm for VPP participation in electricity spot markets and provides valuable insights into communicationenabled power systems, distributed electromagnetic information net...
Peng-Tao Hu, N. Shen, H. Guo et al.· Advanced Electromagnetics· 0 citations
The South African electricity supply sector is undergoing structural reform, with balancing and ancillary-service markets likely to increase the need for active portfolio scheduling under supply shortages and grid constraints. This paper formulates a day-ahead virtual-grid optimal power flow problem for a geographi...
G. Greubel, A. Kalam, Amit Agarwal· Frontiers in Energy Research· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
MIT News · Artificial Intelligence· news.mit.eduOct 7, 2026
Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.
Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduOct 6, 2026