Skip to content

Category

machine learning

18,068 papers

#machine learning Preprint Open access Oct 2026

SURF: Steering the Scalarization Weight to Uniformly Traverse the Pareto Front

Scalarization is widely used in multi-objective optimization owing to its simplicity and scalability. In many applications, the goal is to generate solutions that represent diverse user preferences, ideally with uniform coverage of the Pareto front (PF). However, uniformly sampling scalarization weights usually induces...

Liuyuan Jiang, Chentong Huang, Lisha Chen · 0 citations
#machine learning Preprint Open access Oct 2026

Quadratic Characterizations for Reachability Analysis of Neural Networks

Quadratic constraints (QCs) are widely used to characterize nonlinearities and uncertainties, but generic analytical characterizations can be conservative on bounded domains. This paper develops a framework for constructing verified quadratic characterizations of scalar relations in the two-dimensional real plane. Cand...

Elias Khalife, Mazen Farhood, Pierre-Loic Garoche · 0 citations
#machine learning Preprint Open access Oct 2026

Bayesian Nonparametric Mixed-Effect ODEs with Gaussian Processes

Dynamical modelling in pharmacometrics, systems biology, and epidemiology often involves subjects with related but distinct dynamics, observed through temporally sparse and irregular measurements. Classical nonlinear mixed-effects ODE models represent this heterogeneity but rely on parametric vector fields, making them...

Julien Martinelli, Maksim Sinelnikov, Harri L\"ahdesm\"aki et al. · 0 citations
#machine learning Preprint Open access Oct 2026

On the Approximation Complexity of Matrix Product Operator (MPO) Born Machines

Matrix product operator Born machines (MPO-BMs) are tractable tensor-network models for probabilistic modeling, yet their approximation capabilities remain poorly understood in theory. In this paper, we characterize these capabilities from both negative and positive perspectives. As a negative result, we prove that con...

Chao Li, Zerui Tao, Yuchen Cong et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Model Capacity Determines Grokking through Competing Memorisation and Generalisation Speeds

Existing accounts of grokking explain the phenomena in terms of mechanistic frameworks such as circuit efficiency or lazy-to-rich transitions. However, despite a known dependence between grokking and model size, how model capacity shapes grokking remains an open question. We give an information-theoretic account of thi...

Yiding Song, Hanming Ye · 0 citations
#machine learning Preprint Open access Oct 2026

Reinforcement learning for inverse silhouette design and rapid laser cutting of compact parallelogram quad kirigami prototypes

Kirigami is an increasingly useful fabrication method to produce shape-programmable metamaterial structures. However, inverse design remains difficult because deployment is nonlinear, and feasible cut layouts must satisfy discrete compatibility rules, avoid overlap, and map one target shape to valid designs. We present...

Milad Yazdani, Shahriar Shalileh, Dena Shahriari · 0 citations
#machine learning Preprint Open access Oct 2026

Constrained Triple-Head Price Optimization (C3PO) Network for Discrete-Choice Models

We propose a Constrained Triple-Head Price Optimization (C3PO) network for real-time bi-level decision making in discrete-choice environments. In these settings, a seller selects product or service offerings to achieve business objectives, while heterogeneous users make personalized acceptance or rejection decisions ba...

Shivaram Subramanian, Zhengliang Xue, Markus Ettl et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Playing the network backward: A Game Theoretic Attribution Framework

Attribution methods explain which input features drive a model's prediction, making them central to model debugging and mechanistic interpretability. Yet backward attribution methods, including gradients, LRP, and transformer-specific rules, lack a shared framework in which to compare the underlying backward calculatio...

Jakob Paul Zimmermann, Jim Berend, Georg Loho et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Approximating Uniform Random Rotations by Two-Stage Structured Hadamard Rotations in High Dimensions

Uniform random rotations are useful in fast Johnson--Lindenstrauss embeddings, kernel approximation, communication-efficient learning, and recent AI compression pipelines, but are computationally expensive to generate and apply in high dimensions. A practical alternative repeats Walsh--Hadamard transforms with random s...

Tomer Zilca, Gal Mendelson · 0 citations
#machine learning Preprint Open access Oct 2026

Koopman-Based Nonlinear Identification and Model Predictive Control of a Turbofan Engine

This paper investigates Koopman operator-based approaches for multivariable control of a two-spool turbofan engine. A physics-based component-level model is developed to generate training data and validate the controllers. A meta-heuristic extended dynamic mode decomposition is adapted, with a cost function designed to...

David Grasev · 0 citations
#machine learning Preprint Open access Oct 2026

Weight Clustering Reveals the Importance of Relative Rank in Large Language Models

Large language models (LLMs) contain billions of parameters, but many exact weight values are not essential. We apply scalar $K$-means clustering to pretrained models, replacing each weight matrix with only 16--64 shared values. For Llama~3.1-8B-Instruct and SmolLM2-135M, this preserves strong accuracy without retraini...

Borja Aizpurua, Sukhbinder Singh, Rom\'an Or\'us · 0 citations
#machine learning Preprint Open access Oct 2026

Bridge Matching Sampler: Scalable Sampling via Generalized Fixed-Point Diffusion Matching

Sampling from unnormalized densities using diffusion models has emerged as a powerful paradigm. However, while recent approaches that use least-squares `matching' objectives have improved scalability, they often necessitate significant trade-offs, such as restricting prior distributions or relying on unstable optimizat...

Denis Blessing, Lorenz Richter, Julius Berner et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.