Skip to content

Category

small language model

3,130 papers

#artificial intelligence Preprint Oct 2026

HACHIMI-II: From Role-Play to Learner Behavior Modeling for Faithful Student Simulation

Simulated students let researchers test tutoring systems and teaching strategies before real learners are available, but only if the simulation reproduces where a particular learner succeeds and fails. The common approach asks a large language model to role-play a student, but a role does not model what this learner kn...

Yi-Lin Jiang, Fei Tan, Xuan-Yu Yin et al. · 0 citations
#machine learning Preprint Oct 2026

INTACT: Inducing Latent Reasoning on a Frozen Backbone

Latent reasoning replaces natural-language chains of thought with compact continuous"soft-token"representations, reducing the number of intermediate tokens that must be decoded autoregressively. We use a small external encoder to induce latent reasoning in a frozen backbone model. The encoder iteratively maps the backb...

Kutay Tire, Atula Tejaswi, Haris Vikalo et al. · 0 citations
#machine learning Preprint Oct 2026

Target-Token Asymmetry Can Masquerade As Depth Specialization

Layer-ablation studies often perturb early or late layers of a language model, compare the damage to prediction on two corpora, and read a larger early-layer effect on one corpus as early-layer specialization for its task. Such a comparison averages over the tokens that each corpus asks the model to predict, and these...

Dan-Lin Li, Miao Li, Xu Han et al. · 0 citations
#machine learning Preprint Oct 2026

When Non-Adversarial Noise Hurts Learning: Benchmarking Skill Self-Evolution in Agents

Large language model agents increasingly improve by distilling experience into reusable skills, but errors in that experience can persist in learned rules and affect later tasks. Existing evaluations largely examine clean learning or perturbations encountered after skills are frozen, leaving robustness during self-evol...

Tao Yu, Zhong-Tian Luo, Yu-Chen Long et al. · 0 citations
#machine learning Preprint Oct 2026

Progress-Aware Distillation for Mitigating Stagnation in Small Language Model Agents

While LLM-based agent systems have demonstrated remarkable proficiency in reasoning and solving complex real-world tasks, they also come with substantial token consumption and inference latency, limiting their practical deployment. To enhance the efficiency of agent systems, recent efforts have focused on transferring...

Yuan-Pu Cao, Saket Sathe, Hanyu Wang et al. · 0 citations
#small language model Preprint Oct 2026

Enforcing a Strict Safety Margin in LLM Text Generation via Barrier Lyapunov Control

This work derives an explicitly computable sufficient disturbance budget under which the clearance guarantee degrades gracefully, and proves that the clearance margin is never violated and that the prescribed clearance is restored exponentially, yielding an explicit clearance floor.

Anand Singh, Shubham Singh, Anjali Tiwari et al. · 0 citations
#small language model Preprint Oct 2026

On separable pairs of fields and beautiful pairs of separably closed valued fields

We continue the study of beautiful pairs of henselian valued fields, initiated in joint work of the second author with Cubides Kovacsics and Ye. As our main result, we show that separably closed non-trivially valued fields of arbitrary imperfection degree admit beautiful pairs which are elementary pairs satisfying cert...

Zheng-Qing He, Martin Hils · 0 citations
#small language model Preprint Oct 2026

FrameLite: Decision-Oriented Aesthetic Cropping with a Compact Vision-Language Model

This work proposes FrameLite, a compact cropping model built on Qwen3, which outperforms the compared large-VLM croppers across public benchmarks with a substantially smaller backbone and develops three-stage training to turn this potential into stronger direct predictions.

Jian-Ze Li, Kai Liu, Zi-Qing Zhang et al. · 0 citations
#small language model Preprint Oct 2026

RepProbe: Can Video Language Models Count Repeated Actions? A Diagnostic Benchmark

RepProbe, a benchmark of 42K real and synthetic video clips containing exactly k in [1, 20] complete repetitions, finds a consistent representation-to-output dissociation: substantial count information remains linearly decodable even when models fail to report the correct count.

Mahsa Khoshnoodi, S. Bargal · 0 citations
#edge computing Open access Oct 2026

A neuro-symbolic clinical decision support system for chronic pain management using structured derivation traces, adaptive compute, and knowledge graph constraint checking: comparison with 30 physicians from pain-relevant specialties

Chronic pain management requires complex multidisciplinary reasoning integrating pharmacological, interventional, rehabilitative, and psychosocial approaches across multiple guideline frameworks (International Association for the Study of Pain [IASP], American College of Rheumatology [ACR], European Alliance of Associa...

Mete Tuğcan Üçdal, Evren Ekingen, Ali Niyazi Kurtcebe · 0 citations
#small language model Book Oct 2026

Authenticity and autonomy in EFL classrooms in Macao and Indonesia

Mark Feng Teng incorporates authentic materials into his academic writing classes in Macao to expose students to real-life language use and designs tasks to develop communicative skills. He structures lessons into three phases: teacher’s time, when he models academic skills that students will use later; learners’ time,...

Mark Feng Teng, Ummi Kultsum, Atik Yuliyani et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.