Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Open access Oct 2026

DeDiCa: A Scalable Deconfounding Discrete Causal Generative Model

We introduce DeDiCa, a practical framework for efficient causal inference with discrete variables and hidden confounding that revisits classical probabilistic modeling through a tensorized parameterization of causal Bayesian networks, enabling tractable inference. Given a causal graph, DeDiCa is trained once on observa...

Kunchangtai Liang, Adri\'an Javaloy, Antonio Vergari et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Beyond Marginal Influence: Interaction-Aware Memory Selection for LLM Agents

LLM-agent memory selection often uses retrieval rankings based on record relevance or individual influence. Such rankings cannot identify sufficient subsets under redundant or jointly necessary evidence. We study per-decision memory sufficiency: selecting a small subset that preserves full-memory behavior. To separate...

B. Subrahmanyam, Neeraj Choudhary · 0 citations
#machine learning Preprint Open access Oct 2026

ADT: All-Atom Diffusion Tokenizer for 3D Molecular Structures

Discrete structural tokenization provides a promising route to autoregressive 3D molecular generation. Yet, existing tokenizers face a trade-off between compact representation and all-atom reconstruction: atom-level tokens preserve atomic details but produce long sequences, while compact residue-level protein tokens ty...

Xuantuo Huang, Encheng Su, Aoran Wang et al. · 0 citations
#machine learning Preprint Oct 2026

Sample, Mix, or Verify? Allocating Test-Time Compute under Imperfect Verifiers

A common way to make language models and agents more accurate is to spend more compute at inference time: generate many candidate solutions and submit the one a verifier prefers. Success then requires that some candidate is correct and that the verifier picks it. The first grows predictably with the number of samples;...

Srinivasan Iyengar · 2 citations
#machine learning Preprint Oct 2026

FLARE: Physics-Grounded Evaluation of Language-Model Agents for Feeder Restoration with Degraded Observations

FLARE (Feeder-Level Agent Restoration Evaluation), a physics-grounded benchmark for post-isolation feeder restoration, is introduced and enables reproducible evaluation of language-model based restoration support while emphasizing the need for external safety checks.

B. Subrahmanyam, Neeraj Choudhary · 0 citations
#machine learning Preprint Open access Oct 2026

Anisotropic Representation Dynamics in Transformers

Small differences between internal representations can shrink or grow as they pass through a Transformer layer, affecting how information is preserved and how sensitive the model is to perturbations. Yet it remains unclear when changes in attention weights can turn a representation difference that would otherwise shrin...

Nguyen Do, My T. Thai · 0 citations
#machine learning Preprint Oct 2026

Response-Informed Value Estimation for Cost-Aware Multi-Turn LLM Routing

RIVET jointly trains two value estimators over a shared state-model representation: a deployable Routing Value Estimator that scores candidate models from pre-call information, and a training-only Response-Informed Value Estimator that additionally observes the realized response.

Hao-Tian Yan, Jia-Qi Liu, Bing-Yi Jing et al. · 0 citations
#machine learning Preprint Oct 2026

Process Reward Modeling with Reliability- and Conservatism-Aware Bayesian Belief

BayesianPRM is proposed, which treats the process reward as a random variable within a reward hypothesis space and maintains a Bayesian belief over it, and yields a reliability- and conservatism-aware Bayesian belief, whose expectation determines the process reward.

Zhong-Jian Qiao, Zhi-Xiang Zhou, Jiafei Lyu et al. · 0 citations
#machine learning Preprint Oct 2026

Non-Parametric Optimization for Scalable Learning in Stochastic Decision Problems

Stochastic optimization (SO) plays a central role in decision-making under uncertainty. Among SO problems, time-varying stochastic optimization (TV-SO) is particularly important due to its applications in adaptive control and machine learning. Non-parametric approaches have been proposed for time-varying deterministic...

Mohsen Amidzadeh, L. Viitasaari, M. Di Francesco · 0 citations
#artificial intelligence Preprint Oct 2026

LangNCO: Compiling Natural-Language Constraints into Inference-Time Interventions for Neural Combinatorial Optimization

Neural combinatorial optimization (NCO) rapidly produces high-quality solutions for problem structures encountered during training, but operational requirements may change after deployment and be communicated in natural language. We propose LangNCO, a framework that compiles instance-specific requirements into structur...

Hironori Ohigashi · 0 citations
#artificial intelligence Preprint Open access Oct 2026

A Stronger Teacher Within: Strengthening MoE Models via On-Policy Bidirectional Distillation

Reinforcement Learning with Verifiable Rewards (RLVR) has substantially improved Mixture-of-Experts (MoE) LLMs, but its outcome-level rewards provide only sparse supervision. On-Policy Distillation offers dense token-level feedback, yet requires a stronger compatible teacher, while on-policy self-distillation relies on...

Haoyu Chen, Jun Bai, Yang Liu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Tree-Aware Posterior Distillation for Long-Horizon Agentic Reinforcement Learning

Reinforcement learning with verifiable rewards has become a scalable post-training paradigm for large language models. However, training agents over long-horizon interactions presents two challenges: using only terminal rewards makes turn-level credit assignment sparse and high-variance, while sequential mini-batch upd...

Heming Zou, Qi Wang, Yi-Xiu Mao et al. · 1 citation

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.