Skip to content

Category

machine learning

17,191 papers

#artificial intelligence Preprint Oct 2026

Learning When to Commit: Schedule Distillation for Fast Diffusion Language Models

Diffusion large language models (dLLMs) can generate multiple tokens in parallel, but often require many decoding rounds to complete a response. Efficient generation depends not only on which tokens are easy to predict, but also on how committing to them helps predict the remaining positions. A highly predictable token...

Aidar Myrzakhan, Zhi-Qiang Shen · 0 citations
#artificial intelligence Preprint Oct 2026

Making Reasoning Visible: Configuration-Aware Diagnostic Modeling for Adaptive Scaffolding in Structured Reasoning Tasks

Modeling the latent, multi-step reasoning processes of learners is a core challenge for adaptive tutoring systems, which often rely on simple right/wrong answers rather than understanding how students think. Instantiated here for grammatical reasoning, this study introduces a diagnostic framework that makes students'st...

Trystan Geoffre, Zheng Yuan, Thierry Geoffre · 0 citations
#machine learning Preprint Open access Oct 2026

The Geometry of Emotion Representations Across Scale, Depth, and Instruction Tuning

We measure the emotion geometry of six LLMs spanning Google's Gemma 2 family. Using an extraction pipeline established by Sofroniew et al. (2026) on Claude Sonnet 4.5 and replicated by Hollowell (2026) on Gemma 2 27B base, we compare emotion geometry across base and instruction-tuned variants of Gemma 2 2B, 9B, and 27B...

Adam Hollowell · 0 citations
#artificial intelligence Preprint Open access Oct 2026

SVD-Attention: Efficiently Analyzing Attention Blocks in Transformers

Pretrained transformers spend a large share of their inference compute inside self-attention, yet the per-head query-key interaction is structurally low-rank by construction. We ask a diagnostic question: across layers and architectures, which heads actually use the full rank budget on real data, and which do not? We p...

Debopam Sanyal, Hongjie Chen, Riya Elizabeth Kuriyan et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

HARP-LoRA: Hierarchy-Conditioned Rank Projection for Low-Rank Adaptation in Scientific Table Understanding

Tabular data is widely used in scientific applications, where complex layouts, including multi-level headers, merged cells, captions, and footnotes, make information extraction difficult. This is particularly important in pharmacokinetics (PK), where values must be correctly associated with the drug, species, dose, adm...

Hossein Sholehrasa, Mohammadhossein Amini, Doina Caragea et al. · 0 citations
#artificial intelligence Review Oct 2026

Large Language Models: A Plain-Language Overview for Engineers

The article starts with the Transformer, which connects words in context, and pre-training, where models learn to predict text, and explains how fine-tuning adapts models to requests, with reinforcement learning from human feedback using human answer rankings.

Bahaeddin Turkoglu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Efficient Proof Generation for Lean Statements with Multiple Candidate Answers

In formal systems such as Lean 4, efficiently finding answers to mathematical problems and generating verifiable proofs is an important task in automated mathematical reasoning. In the traditional way where an upstream solver provides multiple candidate answers, the common workflow requires searching for proofs for eac...

Pengzhen Lin, Ke Zhang, Maziar Raissi et al. · 0 citations
#machine learning Preprint Oct 2026

Transformer to GPT-5: Advancements, Limitations, and Future Directions in Large Language Model Design

Large Language Models (LLMs) have revolutionized Artificial Intelligence (AI) by their extraordinary capabilities, like contextual understanding, few-shot/zero-shot learning, code generation, ability to reason and problem-solving. Recent studies have shown immense work on LLMs. Yet, there is limited work on the thoroug...

Harsidak Singh Banwait, C. Prabha · 0 citations
#artificial intelligence Preprint Open access Oct 2026

$\Delta\tau$-Bench: Pushing Agents Toward a Moving Capability

In this paper, we introduce $\Delta\tau$-Bench, an executable agent benchmark that models the structural evolution of large tool ecosystems. In $\Delta\tau$-Bench, independently evolving services continually reshape how tasks can be accomplished: familiar tools may disappear or be replaced, while more efficient alterna...

Shuofei Qiao, Xuanguang Pan, Yijun Chen et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

T2D: Target-to-Draft Model Pruning & Adaptation for Efficient Speculative Decoding

Speculative decoding significantly accelerates autoregressive text generation in Large Language Models (LLMs), but its efficacy depends largely on two key factors: the distributional alignment between the draft and the target model, and the draft model's latency during inference. However, existing approaches typically...

Shahriar Kabir Nahin, Xiao Ye, Muhao Chen et al. · 0 citations
#machine learning Preprint Open access Oct 2026

EdgeDeID: A 0.6B Clinical De-identifier Trained Without Real Patient Data

De-identifying clinical notes with a hosted language model discloses the information the step is meant to protect. We present EdgeDeID, a 0.6B-parameter decoder-only de-identifier that runs locally and is trained without real patient text: three LLM teachers write synthetic notes, a single labeler re-annotates them int...

Sina Daneshgar, Raya Namazi, Amirali Khosravi et al. · 0 citations
#artificial intelligence Preprint Oct 2026

TriageRAG: Failure-Aware Self-Training for Adapting Retrieval-Augmented Language Models to Specialized Domains

Retrieval-augmented generation (RAG) lets large language models (LLMs) answer knowledge-intensive questions from retrieved evidence, but adapting a general-purpose RAG system to a specialized domain such as medicine is difficult when only an unlabeled corpus is available. Self-training approaches such as SimRAG address...

Samarth Varshney, R. Yadav · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.