Skip to content

Category

small language model

3,244 papers

#large language models Dataset Open access Oct 2026

Curated Intent Classification Dataset and Robustness Test Set for a Two-Stage Mental Health Chatbot

This record provides the evaluation data accompanying the paper “A Safety-First Two-Stage Mental Health SupportChatbot: Robust Crisis Routing andRetrieval-Grounded Response Generation” (SU26 DAP Group 4, FPT University, Can Tho Campus). The data is designed to stress-test the robustness of a two-stage mental-health sup...

Vinh Hung Ho · 0 citations
#protein folding Book Open access Oct 2026

SCARSE: Small-sample Cross-validation-Anchored Regression Solution for low resource peptide Engineering

Overview In this Zenodo upload, we introduce both the code for SCARSE (scarse.zip) and the reproducability code (SCARSE-repro.zip). How SCARSE works SCARSE is designed for peptide property prediction in low-data regimes by combining protein language model embeddings with classical machine learning methods. The workflow...

Leo Andrekson, Robin Rydbergh, Rocío Mercado et al. · 0 citations
#small language model Dataset Open access Oct 2026

Socratic guiding questions in synthetic arithmetic data: matched LoRA runs (revision v2)

Supporting data, adapters, predictions and code for the article *Low-Cost LoRA Fine-Tuning of Small Language Models for Multi-Step Arithmetic Reasoning* by Jake O'Grady, Asena Isik Gürhan, Chee Fong Ting and Effirul Ramlan (University of Galway). We generated 20,000 GSM8K-derived arithmetic problems with step-by-step s...

O'Grady, Jake, Gürhan, Asena Isik, Chee, Fong Ting et al. · 465 citations
#small language model Preprint Oct 2026

Skill-SLM: Agent Skill-driven Small Language Models for Reliable Robot Operation

Skill-SLM is proposed, a framework that reformulates SLM-driven robot operation as a task-decomposition and skill-composition problem, and employs a progressive skill orchestration strategy to improve the reliability of skill implementation and overall robot operation.

Wen-Hao Wang, Yan-Yan Li, Jia-Wei Yuan · 0 citations
#small language model Preprint Oct 2026

Listen-to-Reason: Listen with Experts, Retrieve over a Graph, Reason with LLMs

Listen-to-Reason (L2R), an interpretable-by-design pipeline that passes audio to the LLM through an explicit, human-readable tree that outperforms all LALMs the authors compare against on SAKURA and trails them by 6-12 points on MMAU and MMAR, is proposed.

Pooneh Mousavi, M. Ravanelli, Cem Subakan · 0 citations
#small language model Preprint Oct 2026

Localized, unstable, and entangled: Exploring `Us vs. Them'bias in Large Language Models

Large language models (LLMs) exhibit us-vs.-them bias: A behavioral asymmetry in which prompts framed around an ingroup (``we''/``us'') receive systematically more positive continuations than matched prompts framed around an outgroup (``they''/``them''). Using Edge Attribution Patching (EAP), we localize this behavior...

Tabia Tanzin Prama, J. Zimmerman, C. Danforth et al. · 0 citations
#small language model Preprint Oct 2026

AutoSynth: Learning to Generate Editable Synthesizer Programs from Audio and Text

AutoSynth, which represents MIDI performance events, fixed synthesizer parameters, and variable-length modulation routes as a unified sequence for a synthesizer, and learns their dependencies with an audio-conditioned autoregressive model, is presented.

Tristan Wu, Daniel Chin, Li-Wei Lin et al. · 0 citations
#small language model Review Open access Oct 2026

Artificial Intelligence in Mass Spectrometry-Based Metabolomics and Lipidomics for Drug Discovery and Development.

Artificial intelligence applied to mass spectrometry-based metabolomics and lipidomics has advanced through three technological generations: chemometric and classical machine learning, deep learning, and self-supervised foundation models, with large language models so far entering mainly at the edges. The metabolome an...

Young Cheol Yoon, Seoyeon Choi, C. Jung et al. · 0 citations
#natural language process... Preprint Oct 2026

Specialized Decision Models vs. General-Purpose LLMs: Benchmarking Jev Across Knowledge, Reasoning, and Multilingual Tasks

Jev is a"System One"model that returns a choice among given options instead of generating text. We study how such a specialized decision model compares with general-purpose large language models (LLMs). We evaluate Jev on 13 multiple-choice benchmarks covering knowledge, reasoning, and multilingual understanding, and c...

Xing Li, Qing-Cheng Chang, Jin-Zhong Ning et al. · 0 citations
#natural language process... Preprint Oct 2026

Easy to anticipate, hard to compute: boundary dependence finds the computed outputs that entropy patching misses

Byte-level language models such as the Byte Latent Transformer (BLT) group bytes into patches and run their large global model once per patch. BLT starts a patch where a small model's next-byte entropy is high, so global compute goes where the next byte is hard to predict. We show that this rule has a systematic blind...

Nicolás Vera Zúñiga · 2 citations
#natural language process... Preprint Oct 2026

Local Prototype Reconstruction for Text-Compatible Speech-to-LLM Bridge Pretraining

Speech-to-LLM systems often connect a frozen speech encoder to a frozen large language model (LLM) through a small trainable bridge. The bridge is usually treated as plumbing, but it in fact defines the geometry of the speech-to-LLM interface, and the pretraining objective decides whether that interface provides a reus...

Xin-Nian Zhao, Chia-Hua Wu, Pu Wang et al. · 0 citations
#natural language process... Preprint Oct 2026

Sparse Attention Is Matrix Approximation, Not Choosing from a Bag of Values

Large Language Models (LLMs) achieve strong performance across many domains, but their efficiency is limited by the quadratic cost of attention with respect to prompt length. Sparse attention reduces this cost by retaining only a small fraction of query-key interactions to approximate the full attention matrix. However...

Fang Wan, Xu-Feng Liu, Fan Li et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.