Skip to content

Differentiable Electricity-Market Clearing for Gradient-Based Planning

Sep 2026 · 0 citations · 12 references
Computer Science

TL;DR

Differentiable market clearing turns market-aware planning into a problem gradients can search: each forward pass solves the market, and reverse-mode automatic differentiation propagates the planning cost back through the cleared prices to the plan.

Abstract

Planning a large data center is difficult because a facility big enough to matter changes the electricity prices it will pay. Those prices are set by market clearing, a constrained optimization problem solved anew in every operating condition. However, simulating the market tells a planner how a candidate plan performs but not how to improve it. Here we treat market clearing as a differentiable optimization layer: each forward pass solves the market, and reverse-mode automatic differentiation propagates the planning cost back through the cleared prices to the plan. After validating these gradients against finite differences, we apply them to a concrete problem: allocating 50 MW of data-center load across six candidate buses in two synthetic networks, under a fixed cost per active site, evaluated over 36 operating states. Judged against exhaustive enumeration of all site combinations, gradient optimization recovers the continuous allocations almost exactly, with worst-case objective gaps of 2.3\% and 8.5\% of the cost difference between the best and worst single site. Its one systematic error is instructive: near the costs at which a site should close, the smooth relaxation of the discrete site count shrinks the site rather than closing it, so discrete transitions arrive late. Differentiable market clearing thus turns market-aware planning into a problem gradients can search.

View source

Similar papers

Open access Sep 2026

A Shadow Price-Guided Computational Framework for Congestion-Aware Transmission Expansion Planning

Transmission expansion planning (TEP) for renewable-rich power systems requires a computational workflow that links investment decisions with chronological operations and nodal economic signals. This study presents a shadow price-guided framework integrating hourly DC optimal power flow, multi-hour candidate screening,...

Yu Chen, Song-Tao Lin, Yu-Hua Gao et al. · 0 citations
Conference Sep 2026

A Distributed Optimization Approach for TSO-DSO Coordination under Electricity and Carbon Markets

Recent efforts to decarbonize power systems have led to the development of carbon-aware optimal dispatch models. Existing approaches typically focus on modeling either the distribution or the transmission system, disregarding the effects of their operation decisions on each other. Nonetheless, there are a few attempts...

W. Faria, Gregorio Muñoz-Delgado, Javier Contreras et al. · 0 citations
Preprint Aug 2026

Models and Algorithms for Reserve Deliverability in Cross-Zonal Balancing Capacity Markets

In power markets where the physics of the transmission grid is closely represented in market clearing models, certain cross-zonal power exchanges can take place only if other exchanges occur concurrently. This leads to challenges in cross-zonal balancing capacity markets, where the activation of reserves in real time r...

M. Madani, Zejun Ruan, Anthony Papavasiliou · 0 citations
Preprint Sep 2026

Optimal Uniform Pricing for Multi-Interval Dispatch without Make-Whole Uplifts

In a network with ramp-limited generators and inaccurate net-demand forecasts, practical rolling-window dispatch can drive locational marginal prices (LMPs) below generators'bid-in offers. In such cases, out-of-market (OOM) settlements are used to compensate generators and maintain dispatch-following incentives, but OO...

Valentina Norambuena-Guzmán, Cong Chen, Tong Lang et al. · 0 citations
Open access Aug 2026

Constructing the Optimal Bidding Path for VPPS Participating in the Spot Market Using the DDPG Reinforcement Learning Algorithm

This study proposes an optimal bidding path construction framework based on the Deep Deterministic Policy Gradient (DDPG) reinforcement learning algorithm for VPP participation in electricity spot markets and provides valuable insights into communicationenabled power systems, distributed electromagnetic information net...

Peng-Tao Hu, N. Shen, H. Guo et al. · 0 citations
Open access Aug 2026

Analysis of optimal power flow for day-ahead scheduling in South Africa using biologically inspired algorithms

The South African electricity supply sector is undergoing structural reform, with balancing and ancillary-service markets likely to increase the need for active portfolio scheduling under supply shortages and grid constraints. This paper formulates a day-ahead virtual-grid optimal power flow problem for a geographi...

G. Greubel, A. Kalam, Amit Agarwal · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 7, 2026

Discovering the value of humanistic inquiry

Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.

Microsoft Research Blog Oct 7, 2026

Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses

Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.