Skip to content

Online local learning for generative thermodynamic computing

Sep 2026 · 0 citations · 36 references
Physics Computer Science

TL;DR

A local online training method is established and how update timing, noise structure, and precision affect generative thermodynamic computing is shown.

Abstract

Generative thermodynamic computers turn thermal noise into structured data through Langevin dynamics. We train these systems with a local update at each integration step. The reverse-path Onsager-Machlup objective yields a coupling gradient that is a symmetric sum of local residual-state correlations. We apply this gradient immediately rather than accumulating it over a full trajectory. In digital simulations using MNIST prototypes, online and trajectory-batch training reach similar validation losses on fixed noising paths. Models trained online release less heat on average in all five independently seeded pairs, with both models'parameters held fixed during sampling. Auxiliary classifier and nearest-prototype measures change modestly, while pairwise diversity decreases. The response to noise depends strongly on where the errors enter: independent zero-mean errors in the formed updates produce little heat change over a finite range of noise amplitudes, whereas residual offset and temporal correlation have much larger effects. Storing trained couplings requires substantially less precision than resolving deterministic updates during training. Together, these results establish a local online training method and show how update timing, noise structure, and precision affect generative thermodynamic computing.

View source

Similar papers

Bridging Stochastic Flow Maps and Boltzmann Generators with Normalizing Flows

Normalizing Flow Flow Maps (NF$^2$M), which combines the strengths of recent stochastic flow maps with the tractability of classic normalizing flows to build a Boltzmann Generator, and is evaluated on peptide systems, demonstrating improved sampling efficiency and sample quality.

Louis Grenioux, Rui-Kang Ouyang, Lu-Huan Wu · 0 citations
#machine learning Preprint Aug 2026

Propensity Straight-Through Gradients for Discrete Stochastic Systems

This work exploits the affine state update to obtain the exact one-step conditional-mean sensitivity by differentiating normalized reaction propensities, and defines the propensity straight-through (PST) estimator, a temperature- and Gumbel-free path to scalable gradient-based learning through exact stochastic trajecto...

Jose M. G. Vilar, Leonor Saiz · 0 citations

Neural Transport Nested Sampling

This work develops a novel sampling algorithm, Neural Transport Nested Sampling (NTNS), which combines the classical strengths of nested sampling with modern neural flow-based methods, and is the first neural sampler to return a calibrated, temperature resolved partition function estimate at this scale.

D. Yallup, Will Handley · 1 citation
Preprint Sep 2026

Deep Generative Markov State Models with Experimental Restraints

BICePs-reweighted Reversible DeepMSMs are introduced, combining Bayesian Inference of Conformational Populations (BICePs), variational learning of Markov processes, and maximum entropy (MaxEnt)/maximum caliber (MaxCal) principles to infer consistent thermodynamics and minimally perturbed kinetics.

Robert M. Raddi, Vincent A. Voelz · 0 citations
#machine learning Preprint Sep 2026

FrOGS: Discrete Neural Sampler for Independent Alloy Configurations Across Chemical Conditions

Free energy Offering Generative Sampler (FrOGS), a hybrid discrete neural sampler that couples an autoregressive model to a continuous-time Markov chain to be trained jointly under a single shared loss to produce estimates on a common absolute free-energy scale.

Kyucheol Min, E. Hofgard, T. Smidt · 1 citation · ⚡1
#machine learning Preprint Sep 2026

Mechanism-Aware Ensemble Conditioning for Data-Limited Emulation of Extreme Events

A mechanism-aware conditioning plug-in framework that turns a nudged coarse ensemble into a non-intrusive sensor of local instability geometry, showing that local instability geometry is not merely interpretable post hoc, but an actionable conditioning signal for data-efficient rare-event emulation.

Isabella Thiel, J. Bello-Rivas, Y. Kevrekidis et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Nov 16, 2026

TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient

AI coding agents are increasingly help developers fix bugs and build features largely on their own, but every interaction with their models consumes tokens. In each session, an agent sends instructions, tool descriptions, and session history to its model. Most efforts to reduce this cost focus on individual tasks. Yet developers return to the same […] The post TokenEconomizer: Learning from Experience to Make AI Coding Agents More Efficient appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.