Skip to content

Category

machine learning

18,068 papers

#machine learning Preprint Oct 2026

Counterfactual Certification for Sequential Unlearning with Long-Run Performance Guarantees

Certified machine unlearning ensures the proximity between the unlearned model and a model retrained without the data to be forgotten. Extending this framework to sequential deletion requests, typically arriving as groups of variable size (e.g., all records of one user or of coordinated users), is challenging. For unle...

Hanna Benarroch, Jamal Atif, Olivier Cappé · 0 citations
#machine learning Preprint Open access Oct 2026

Exact power indices for plurality-voting ensembles

Plurality-voting ensembles aggregate the predictions of multiple base classifiers and output the most voted class, with ties typically broken at random. Despite the simple aggregation rule, attributing the impact of each base classifier to the ensemble's predictions is far from straightforward. That is, a single base c...

Ilie Sarpe, Theofanis Georgakopoulos, Aristides Gionis · 0 citations
#machine learning Preprint Open access Oct 2026

Neural Dimensional Analysis: Foundations of Dimensionless and Scale-Consistent Computation

Modern Transformers rely on many scale-control mechanisms, including normalization, residual scaling, attention temperatures, loss weighting, and adaptive updates. To explain how these mechanisms maintain scale consistency, we introduce Neural Dimensional Analysis (NDA), a unified framework based on dimensional consist...

Bum Jun Kim, Makoto Kawano, Yusuke Iwasawa et al. · 0 citations
#machine learning Preprint Oct 2026

Sea-Net: A Small and Inherently Interpretable Neural Network for Time Series Classification

Traditional time-series classification methods often operate as black boxes, providing a class prediction without indicating which time point or time interval within the series led to that prediction. To improve temporal interpretability, MILLET (Multiple Instance Learning with Temporal Explanation), which combines an...

U. ur Rehman, Tanmoy Mondal · 0 citations
#machine learning Preprint Oct 2026

Stein Variational Distributional Reinforcement Learning: Score-Guided Particles for Multivariate Return Distributions

Decisions that weigh several reward signals against each other require the joint distribution of the return vector. Categorical critics scale exponentially in the reward dimension, and quantiles have no canonical multivariate analogue. Multivariate distributional critics therefore represent each return distribution by...

Manuel Haussmann, Melih Kandemir · 0 citations
#machine learning Preprint Oct 2026

NBCLT: Parameter-Agnostic Norm-Ball Clipped Local Training

Distributed learning with multiple local steps reduces communication but aggravates drift, and its practical performance often depends on carefully tuned hyperparameters under heterogeneous data and communication constraints. At the same time, recent Muon-type optimizers suggest that constraining updates within suitabl...

Lin-Xuan Pan, Shu-Cheng Yang, Jun-Chi Yang · 0 citations
#machine learning Preprint Oct 2026

Stable-Plastic Subspace Construction for Differentially Private Continual LoRA

Continual learning (CL) adapts pretrained models to a sequence of tasks while retaining knowledge acquired from earlier tasks. When task data are sensitive, differential privacy (DP) provides record-level protection, but maintaining both adaptation and retention under privacy constraints remains challenging. We study t...

Jin Liu, Ning Xi, Y. Miao et al. · 0 citations
#machine learning Preprint Open access Oct 2026

FlashMask-3: Efficient and Expressive Mask-Aware Distributed Attention

Long-context training of large language and multimodal models couples structured attention masks (document, prefix-LM, share-question, sliding-window, block-sparse) with multi-node context parallelism, making the mask a dominant bottleneck. FlashMask's column-wise sparse mask compresses them from $O(n^2)$ to $O(n)$ via...

Guoxia Wang, Qianyue He, Siming Wu et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Deep Mesoscopic Dynamics

Microscopic simulations resolve spatial patterns but are feasible only over small domains and short timescales, whereas bulk descriptions erase those patterns through spatial averaging. Mesoscopic fields preserve this spatial organisation, but their effective equations are known only for selected microscopic systems an...

Yue Zhao, Shiqi Wu, Yihang Ouyang et al. · 0 citations
#machine learning Preprint Oct 2026

Searching for What Matters: Open-Ended Discovery of Multiple Hypotheses with Agentic Data Exploration

Discovering what drives an outcome from data is central to science and often requires deciding what is worth investigating before a specific hypothesis is known. Yet most existing hypothesis generation settings substantially narrow this search by providing a research question, target relationship, or curated context. W...

Sanchit Kabra, Nurendra Choudhary, Jiang-Shu Du et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Persistence Positional Encoding: A Minimal Transformer Recipe for Persistence Diagrams

Persistence diagrams (PDs) represent multiscale topological information as multisets of birth-death pairs $(b,d)$. How best to use them with Transformers, however, remains unclear. Connecting PDs to Transformers requires choosing how topological information is tokenized and exposed to self-attention. Prior methods use...

Eunwoo Heo, Ganghyun Kim, Jaejun Yoo · 0 citations
#machine learning Preprint Oct 2026

GeoNIRS: Geometry-Aware Pretraining for Heterogeneous fNIRS Representation Learning

Functional near-infrared spectroscopy (fNIRS) provides portable and spatially localized measurements of cortical hemodynamics, but differences in channel count, probe layout, signal distribution, and task type hinder joint pretraining across datasets. We introduce GeoNIRS, a geometry-aware framework that uses source-de...

Zong-Sheng Li, Sheng-Yuan Zhu, Zi-Mo Zhang et al. · 1 citation · ⚡1

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.