Skip to content

Category

machine learning

3,367 papers

#machine learning Open access Apr 2025

Bayesian Experimental Design for Model Discrepancy Calibration: An Auto-Differentiable Ensemble Kalman Inversion Approach

This work clarifies the trade-offs between KL divergence and Wasserstein metrics for the utility function and provides guidelines for selecting suitable criteria in practical BED applications.

Huchen Yang, Xinghao Dong, Jin-Long Wu · 3 citations
#machine learning Conference Open access Mar 2018

Aspiration-based Perturbed Learning Automata

A novel payoff-based learning scheme for distributed optimization in repeatedly-played strategic-form games and it is shown that payoff-dominant Nash equilibria are the only stochastically stable states.

Georgios C. Chasparis · 1 citation

One Model for All: Universal Pre-training for EEG based Emotion Recognition across Heterogeneous Datasets and Paradigms

This work proposes 'One Model for All', a universal pre-training framework for EEG analysis across disparate datasets, and paves the way for more universal, scalable, and effective pre-trained models for diverse EEG analysis tasks.

Xiang Li, You Li, Yazhou Zhang · 0 citations

Large Reasoning Models Learn Better Alignment from Flawed Thinking

RECAP (Robust Safety Alignment via Counter-Aligned Prefilling), a principled reinforcement learning (RL) method for post-training that explicitly teaches models to override flawed reasoning trajectories and reroute to safe and helpful responses, substantially improves safety and jailbreak robustness, reduces overrefusal, and preserves core reasoning capability.

Sheng-Hsuan Peng, E. Smith, Ivan Evtimov et al. · 10 citations · ⚡2

Shift Before You Learn: Enabling Low-Rank Representations in Reinforcement Learning

This work demonstrates that a low-rank structure naturally emerges in the shifted successor measure, which captures the system dynamics after bypassing a few initial transitions, and establishes a connection between the necessary shift and the local mixing properties of the underlying dynamical system, which provides a natural way of selecting the shift.

Bastien Dubail, Stefan Stojanovic, Alexandre Proutière · 4 citations · ⚡1
#machine learning Preprint Jul 2025

RegCL: Compact Continual SAM Adaptation for Visual Grounding in Multi-Sensorial Media

Experiments show that RegCL achieves strong retention and adaptation under domain-incremental learning, outperforming competitive non-replay continual learning and merging baselines, suggesting that RegCL can serve as a compact visual adaptation component for evolving multi-sensorial media pipelines.

Yuan-Chen Shu, Zhiwei Lin, Xiaoyu Zhou et al. · 2 citations

Meta-Prompt Optimization for LLM-Based Sequential Decision Making

The EXPonential-weight algorithm for prompt Optimization} (EXPO) is proposed to automatically optimize the task description and meta-instruction in the meta-prompt for LLM-based agents and is extended to additionally optimize the exemplars (i.e., history of interactions) in the meta-prompt to further enhance the performance, hence introducing the EXPO-ES algorithm.

Ming-Ze Kong, Zhiyong Wang, Yao Shu et al. · 7 citations

Amortizing intractable inference in diffusion models for vision, language, and control

Amortized sampling of the posterior over data is studied, and the asymptotic correctness of a data-free learning objective, relative trajectory balance, is proved for training a diffusion model that samples from this posterior, a problem that existing methods solve only approximately or in restricted cases.

S. Venkatraman, Moksh Jain, Luca Scimeca et al. · 75 citations · ⚡5

Improved off-policy training of diffusion samplers

This work benchmarks several diffusion-structured inference methods, including simulation-based variational approaches and off-policy methods (continuous generative flow networks), and proposes a novel exploration strategy for off-policy methods, based on local search in the target space with the use of a replay buffer.

Marcin Sendera, Minsu Kim, Sarthak Mittal et al. · 52 citations · ⚡7

Biases in Expected Goals Models Confound Finishing Ability

Expected Goals (xG) has emerged as a popular tool for evaluating finishing skill in soccer analytics. It involves comparing a player's cumulative xG with their actual goal output, where consistent overperformance indicates strong finishing ability. However, the assessment of finishing skill in soccer using xG remains contentious due to players'difficulty in consistently outperforming their cumulative xG. In this paper, we aim to address the limitations and nuances surrounding the evaluation of finishing skill using xG statistics. Specifically, we explore three hypotheses: (1) the deviation between actual and expected goals is an inadequate metric due to the high variance of shot outcomes and limited sample sizes, (2) the inclusion of all shots in cumulative xG calculation may be inappropriate, and (3) xG models contain biases arising from interdependencies in the data that affect skill measurement. We found that sustained overperformance of cumulative xG requires both high shot volumes and exceptional finishing, including all shot types can obscure the finishing ability of proficient strikers, and that there is a persistent bias that makes the actual and expected goals closer for excellent finishers than it really is. Overall, our analysis indicates that we need more nuanced quantitative approaches for investigating a player's finishing ability, which we achieved using a technique from AI fairness to learn an xG model that is calibrated for multiple subgroups of players. As a concrete use case, we show that (1) the standard biased xG model underestimates Messi's GAX by 17% and (2) Messi's GAX is 27% higher than the typical elite high-shot-volume attacker, indicating that Messi is even a more exceptional finisher than people commonly believed.

Jesse Davis, Pieter Robberechts · 6 citations

Joint Bayesian Inference of Graphical Structure and Parameters with a Single Generative Flow Network

This paper proposes a method to approximate the joint posterior over not only the structure of a Bayesian Network, but also the parameters of its conditional probability distributions, using a single GFlowNet whose sampling policy follows a two-phase process.

T. Deleu, Mizu Nishikawa-Toomey, Jithendaraa Subramanian et al. · 65 citations · ⚡4

From tech blogs

See all →
MIT News · Artificial Intelligence Aug 27, 2026

Looking beyond natural sequences

A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.