Skip to content

Category

small language model

3,629 papers

#artificial intelligence Preprint Sep 2026

Drift-Aware LLM Routing with Sparse Contexts and Shared Budgets

This work proposes Drift-Aware Sparse Routing (DRS), a nonstationary sparse contextual routing with multiple knapsack constraints and an optional shadow-audit stream that evaluates a small fraction of prompts on several models.

Cheung-Hao Lee, Patrick Wong · 0 citations
#artificial intelligence Preprint Sep 2026

Same Request, Different Boundary: Evaluating Cybersecurity Assistance across Conversational Contexts

3R-Bench (Refusal, Repetition, and Revision), a benchmark of 150 real-world cybersecurity requests augmented with two adversarial conversational settings, is introduced and eight LLMs are evaluated, finding that prior assistant behavior strongly changes responses to an unchanged request.

Rui Yang, Yang Hong, Yi-Chao Xu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Residual Sparsification via Output Importance for Compressing Mixture-of-Experts LLMs

PARSER is a new residual sparsification method that shifts the compression objective from minimizing isolated matrix errors to preserving the expert output error, and achieves this by introducing output importance, which measures the actual contribution to the expert output error.

Seung-Woo Jung, Dohyeok Kwon, Seung-Min Cha et al. · 0 citations
#artificial intelligence Preprint Aug 2026

EGT-KG: Evidence-Grounded Typed KG Retrieval for Practical Scientific QA with Small Language Models

The Evidence-Grounded Typed Knowledge Graph (EGT-KG), a retrieval framework to improve information retrieval with local SLMs is proposed, showing that EGT-KG outperforms the vanilla RAG method in most settings, with the best improvement from llama3:8b.

Mu-Ran Yu, Jie-Chao Gao, Yuan-Dong Pan et al. · 0 citations
#artificial intelligence Preprint Aug 2026

SIR: Self-improving Red-teaming for Compute Use Agents

SIR is presented, a black box IPI attack that composes stealthy injections from a small library of reusable principles stated in plain language and wraps composition in an iterative feedback loop that diagnoses the victim's failed trajectories and distills the bypasses into new, named strategies that are reapplied acro...

Chen Xiong, Zhi-Yuan He, Pin-Yu Chen et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Auditing and Mitigating Privacy Leakage in Cloud-Edge Collaborative Decoding

CoVeil is proposed, a defense mechanism which dynamically optimizes transmitted signals to suppress leakage during decoding time while preserving the collaborative quality, and consistently improves the privacy-utility trade-off over existing baselines by reducing data leakage.

Ke-Jia Zhang, Tianyuan Zou, Zi-Xuan Gu et al. · 0 citations
#artificial intelligence Preprint Aug 2026

TuringLLM: Efficiently Scaling Foundation Models Toward Physical AI

Despite its compact active-parameter budget, Turing-20B-A2B achieves, at the base-model stage, overall general capability exceeding Qwen3-8B Base and approaching Qwen3.5-9B Base, while maintaining strong long-context performance and favorable prefill-latency scaling.

Yu-Heng Zhang, Yi-Zhao Wang, Daijun Zhu et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Dense Clinical Contrasts Enhance Medical Knowledge Updating in Large Language Models

Results show that medical knowledge updating depends not only on the update algorithm, but also on how knowledge is structured as supervision, and suggest that EMQ gives the most stable external transfer and retention among same-budget SFT variants.

Yangmin Huang, Shu Quan, He Geng et al. · 0 citations
#artificial intelligence Preprint Aug 2026

LiteSearch-VL: Small Multimodal Search Agents via Trajectory Distillation and Synthetic Step-DPO

LiteSearch-VL is a low-compute recipe for Qwen3-VL-2B and Qwen3-VL-4B that uses only released OpenSearch-VL trajectories, parameter-efficient LoRA adapters, and synthetic step-level preferences, identifying answer verification, not search depth, as the next bottleneck for small multimodal agents.

Saeed Khaki, Nima Safaei, Kamal Ginotra · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.