Skip to content

Category

small language model

3,445 papers

#small language model Preprint Oct 2026

Omni-Embed-Mini: Binding Modalities Without Forgetting via Dense Distillation

This work presents Omni-Embed-Mini, a 0.9B-parameter model that maps text, speech, audio, images, video, and visually-rich documents into a single shared cosine space without updating any text-side parameter, and is competitive with the closed gemini-embedding-2, edging ahead of it on the overall-modality average.

Mohammed Irfan Kurpath, Jaseel Muhammad Kaithakkodan, Sahal Shaji Mullappilly et al. · 0 citations
#small language model Review Oct 2026

OR for AI That Does OR: Routing LLMs up the Escalator inside the OSCAR Framework

This work develops OSCAR (Optimization modeling by Simulator, Coder, and Reviewer), which uses an offline Simulator certified against labeled decision examples to compare candidates and continues searching beyond feasibility, and model the search for the next certified improvement as sequential decisions under unobserv...

Jin-Zhi Bu, Hai-Xin Tang, Hua-Nan Zhang · 0 citations
#small language model Open access Oct 2026

T-REX: Teaching Large Language Models to Reason with Verbalized Execution Semantics

Large language models (LLMs) have shown strong performance in static code tasks like code search, summarization, and generation, but remain limited in dynamic code reasoning, which involves inferring how programs behave during execution without actually running them. This limitation stems from LLMs being trained on sta...

Yan Wang, Ling Ding, Jie-Chen Sun et al. · 0 citations
#small language model Open access Oct 2026

AIMS-QA: a framework for scaling the assessment of corporate modern slavery statements beyond compliance with AI-driven question answering

Abstract The UK and Australian Modern Slavery Acts require large corporations to disclose annually how they address modern slavery risks in their operations and supply chains. Existing methods assess only a small proportion of these disclosures, or narrowly against explicit legal criteria, overlooking deeper indicators...

A. Bora, Duo-Yi Zhang, H. Thinyane et al. · 0 citations
#small language model Book Open access Oct 2026

Slice-Guided, Context-Augmented Large Language Model Inference of Java Nullability Annotations

A warning-guided, slice-based, LLM-assisted pipeline for inferring Java nullability annotations, which infers the annotations @Nullable and @Nonnull without touching program logic as a step toward a type-system-independent inference technique.

Mushfiqur Rahman Chowdhury · 0 citations
#small language model Book Open access Oct 2026

LPR+: Diverse Transformations for LLM-Aided Program Reduction

Program reduction helps compiler and language-tool developers turn large failure-inducing programs into small, shareable bug reports. LPR (Large Language Models-Aided Program Reduction) demonstrated that large language models (LLMs) can complement syntax-guided reducers by proposing language-specific transformations on...

Ze-Hua Zhang, Jia-Tong Liu, Xue-Song Yao et al. · 0 citations
#small language model Book Open access Oct 2026

RuSMT: An Executable Semantics as Conformance Oracle and Test Suite Synthesizer

Conformance testing asks whether an implementation agrees with its specification. When the specification is expressed in prose, one established approach is to mechanize it as an executable specification. This executable then serves as the oracle, and an input on which an implementation disagrees with it is a potential...

Mehrad Haghshenas, Meng Xu · 0 citations
#small language model Book Open access Oct 2026

STACK: 3D Spatial Task Analysis in Collaborative Construction Keyframes

Analyzing multi-party physical collaboration means tracking what a group builds and whether their actions move the shared structure toward a goal. Vision-Language Models (VLMs) could automate this analysis from session recordings, but existing spatial-reasoning benchmarks use rendered scenes or curated snapshots, not r...

Changsoo Jung, Sheikh Mannan, Jack Fitzgerald et al. · 0 citations
#small language model Book Open access Oct 2026

Benchmarking Vector Quantized Auto-Encoders for Multimodal Vision-Language Tokenization of Medical Images

This work benchmarks both reconstruction quality, codebook collapse and representational capacity of VQ-VAEs across a variety of settings, surpassing state of the art in the reconstruction task and providing a stepping stone for further development of medical multimodal auto-regressive techniques.

Emílio Dolgener Cantú, Manasi Acharya, Jim Berend et al. · 1 citation

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.