Skip to content

Category

small language model

3,317 papers

#small language model Preprint Oct 2026

Why VLMs Miss Small Objects, and When Zooming In Is Safe

A theory built on two quantities of the image interface: S, the number of visual tokens across an object's side, and L, the content a call must cover, which concludes that recognition improves gradually with S, and any search strategy, zoom agents included, obeys a recall-cost frontier.

Jun-Zhe Shi, Yuan Gan, Shi-Da Jiang · 0 citations

Goldsmith: Gold-Loss-Guided Definition Optimization with an Agentic Annotation Harness

Many annotation projects begin before experts have a stable guideline or enough labels to train a task-specific model. We present Goldsmith, an agentic pipeline that turns a small gold set---expert-annotated calibration examples representing the intended task boundaries---into a reusable structured annotation definitio...

Yi-Han Li, Han-Yi Zhang, Xiao-Xi Jiang et al. · 0 citations
#machine learning Preprint Oct 2026

OrBIT: Structure-Guided Embedding Compression

Embedding tables are among the largest components of modern language models. Most compression methods fix a coding geometry such as coordinate blocks, low-rank subspaces, or unrestricted codebooks, and optimize within it. We instead ask whether the coding geometry can itself be discovered. We introduce \emph{OrBIT}, a...

Yunied Puig, Amit Kumar Jaiswal · 0 citations
#machine learning Preprint Oct 2026

Input-Blind Controls Produce Substantial Oracle Headroom for Layer Programs in Multiple-Choice Evaluation

Adaptive computation aims to improve language-model inference by tailoring execution to each input. For layer programs, oracle evaluations use known answers to estimate the potential gain from this flexibility, before a practical selector is available. However, a gain from selection does not by itself explain why the c...

Yi-Bei Guo, Rui Liu · 0 citations
#machine learning Preprint Oct 2026

The Dichotomy Between Pattern Recognition and Step-by-Step Reasoning

We argue that pattern recognition and step-by-step reasoning are two ends of a spectrum. A large language model (LLM) learns to reason step-by-step when data is structured such that the next token depends on a small amount of preceding context. Inference in LLMs resembles pattern recognition when the next token depends...

Amrut Nadgir, Pratik Chaudhari, Vijay Balasubramanian · 0 citations
#machine learning Review Oct 2026

Multi-Label Topic Assignment via LLM Distillation: A Comparative Analysis of Generative vs. Discriminative Student Models

Multi-label topic assignment for user-generated content (UGC) -- including product reviews and buyer-seller conversations -- poses unique scalability challenges in large-scale e-commerce due to informal language, extreme label sparsity, and rapidly evolving taxonomies. While utilizing Large Language Models (LLMs) as la...

Sourabh Kasliwal, Shubhranshu Singh · 0 citations
#artificial intelligence Preprint Oct 2026

Decoupling Logic from Persona: Structural Immunity of Edge LLM Agents to Context Pollution

Small language-model agents on edge devices must hold a persona and reason correctly at once, inside one context window that fills with conversational history and persona instructions. We study what happens to the logical part of such an agent when that history is long, misleading and persona-heavy (persona-logic inter...

Masaaki Nakatsu, Ren-Xiong Wang · 0 citations
#artificial intelligence Preprint Oct 2026

Which Language Should a Skeleton Speak? Language Choices in Multilingual Reasoning

Skeleton-based reasoning prompting is a promising training-free approach for structuring LLM reasoning, but prior work largely assumes an English-centric setting. We propose the Language-Aware Skeleton Exploration Framework (LASEF) to study skeleton-language choice in multilingual mathematical reasoning. Across math be...

HyeonSeok Lim, Seung-Woo Song, Inho Won et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Collaborative Reasoning Distillation via Cross-Feedback and Coherent Curation

Reasoning capabilities are critical for advancing Large Language Models, yet current approaches either require massive computational budgets or struggle to effectively distill reasoning to smaller models. Standard distillation methods rely on outcome-based rewards, failing to distinguish between sound reasoning and luc...

Tae-hong Kim, Seunggeun Cho, Dong-Su Han · 0 citations
#artificial intelligence Preprint Oct 2026

Correspondences as Decisions: JevNexus for Decision-Centric Schema Matching

Schema matching increasingly uses generative language models to rerank retrieved column candidates, although the underlying task is a bounded correspondence decision. We present JevNexus, which combines typed pairwise decisions with schema/instance evidence and invokes listwise refinement only when the evidence disagre...

Run-Ze Li, Han-Chen Wang, Ying Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Mixture of Layers: Dynamic Layer Routing for Visual Reasoning

Pre-trained vision encoders contain layer-wise visual representations that differ in spatial granularity, semantic abstraction, and sensitivity to local details. However, most Multimodal Large Language Models (MLLMs) rely on only the final or penultimate vision encoder representations or fixed aggregation rules, making...

Jeonghwan Kim, S. Stoica, Ji-Wan Chung et al. · 1 citation
#artificial intelligence Preprint Oct 2026

Multi-Objective Aligned Small Language Model Framework for SUD Patient Dialogue Generation

Substance Use Disorder (SUD) counseling requires patient responses that reflect underlying cognitive states such as beliefs, coping strategies, and readiness for change. Although large language models (LLMs) can generate fluent text, they often fail to produce cognitively coherent and clinically realistic patient behav...

Thushara Manjari Naduvilakandy, Hyeju Jang, M. Al Hasan · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 23, 2026

Q&A: How AI came to model the “messy” human mind

Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.