Skip to content

Category

machine learning

18,068 papers

#artificial intelligence Preprint Open access Oct 2026

Probe, Don't Prompt: A Hidden-State Probe for Metadata Filtering in Multi-Meta-RAG

Multi-Meta-RAG improves retrieval for multi-hop question answering by filtering a vector store on metadata, specifically the news source and the publication date, which it extracts from each query using GPT-3.5. This extractor requires a proprietary API call for every query, and its output is not restricted to the allo...

Mykhailo Poliakov, Nadiya Shvai · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Service-Induced Congestion in Memory-Constrained LLM Serving

In large language model (LLM) serving, each request accumulates persistent graphics processing unit (GPU) memory during service as its key-value cache grows with every generated token. Under high concurrency, aggregate memory usage therefore increases endogenously over time: the service process itself creates future ca...

Ruicheng Ao, Jing Dong, Gan Luo et al. · 0 citations

Dynamic Model Merging Made Slim

DiDi-Merging is proposed, which jointly allocates low-rank capacity to these components through differentiable rank selection, followed by data-free parameter-space refinement, followed by data-free parameter-space refinement.

Guo-Dong Du, Wan-Yu Lin · 3 citations
#artificial intelligence Preprint Open access Oct 2026

Abstract Compression of Conversational Audio Context for LLM-based ASR

Standard LLM-based speech recognition systems process utterances in isolation, limiting their ability to leverage conversational context. Here we study whether multimodal context from prior turns improves LLM-based ASR and how to represent that context efficiently. We find that, after supervised multi-turn training, co...

Shashi Kumar, Esa\'u Villatoro-Tello, Sergio Burdisso et al. · 0 citations
#artificial intelligence Preprint Mar 2026

Interpretable PM2.5 Forecasting for Urban Air Quality: A Comparative Study of Adaptive Time-Series Models

These findings show that lightweight additive forecasting strategies can remain highly competitive for urban air-quality prediction, offering a practical balance between accuracy, interpretability, and computational efficiency.

Moazzam Umer Gondal, Hamad Ul Qudous, Asma Ahmad Farhan et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Detection Is Cheap, Routing Is Learned: Why Refusal-Based Alignment Evaluation Fails

Current alignment evaluation mostly measures whether models encode dangerous concepts and whether they refuse harmful requests. Both miss the layer where alignment often operates: routing from concept detection to behavioral policy. We study political censorship in Chinese-origin language models as a natural experiment...

Gregory N. Frank · 0 citations
#artificial intelligence Preprint Open access Oct 2026

TTCS: Test-Time Curriculum Synthesis for Self-Evolving

Test-Time Training offers a promising way to improve the reasoning ability of large language models (LLMs) by adapting the model using only the test questions. However, existing methods struggle with difficult reasoning problems for two reasons: raw test questions are often too difficult to yield high-quality pseudo-la...

Chengyi Yang, Zhishang Xiang, Yunbo Tang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Expected Return Causes Outcome-Level Mode Collapse in Reinforcement Learning and How to Fix It with Inverse Probability Scaling

Many reinforcement learning (RL) problems admit multiple terminal solutions of comparable quality, where the goal is not to identify a single optimum but to represent a diverse set of high-quality outcomes. Nevertheless, policies trained by standard expected return maximization routinely collapse onto a small subset of...

Abhijeet Sinha, Sundari Elango, Dianbo Liu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Activation Sensitivity as a Unifying Principle for Post-Training Quantization

Post-training quantization (PTQ) methods for large language models compress pretrained weights to low bit-widths without retraining by optimizing layer-local proxy objectives. Activation-aware scaling methods such as AWQ protect input channels with large activation norms, whereas second-order error-compensation methods...

Bruce Changlong Xu · 0 citations

OPTIMA: Optimal One-shot Pruning for LLMs via Quadratic Programming Reconstruction

An accelerator-friendly QP solver is implemented that accumulates one Hessian per weight matrix and solves many small QPs in parallel with a convergence certificate per column, enabling one-shot post-training pruning at scale on a single accelerator without fine-tuning.

Mohammad Mozaffari, Samuel Kushnir, Maryam Mehri Dehnavi et al. · 2 citations
#artificial intelligence Preprint Open access Oct 2026

When does Subgroup Balance Matter? Predicting Performance Sensitivity from Latent Separability

Unequal representation of demographic groups in training data poses challenges to model generalisation across populations. Standard practice assumes that balancing subgroup representation always optimises performance. However, recent empirical results contradict this assumption: in some cases, imbalanced data distribut...

Anissa Alloula, Charles Jones, Zuzanna Wakefield-Skorniewska et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.