Skip to content

Category

small language model

3,629 papers

#artificial intelligence Preprint Sep 2026

From Confusion to Clarity: Confusion-Aware Retrieval and Knowledge Injection for Text Classification

A framework is proposed that identifies which label pairs the model struggles to distinguish, expands the candidate set to include confusable labels, and generates targeted rules to differentiate between similar candidates, which requires no fine-tuning and transfers to smaller, cheaper models.

Manish Gupta, Chaitanya Giri, Jayasimha Talur · 0 citations
#artificial intelligence Preprint Sep 2026

LatentPress: Context Compression Beyond Text and Vision

LatentPress is introduced, which writes conversational histories and long documents into a third representation: continuous memory tokens that a frozen decoder reads directly through its input-embedding interface, with no text reconstruction at inference.

Yuanda Xu, Zheng-Ze Zhou, He-Jian Sang et al. · 1 citation
#artificial intelligence Preprint Sep 2026

Efficiently Estimating Optimal Hyperparameter Scaling Laws through Power-Law Entropy Search

This work introduces Power-Law Entropy Search (PLES), a computational cost-aware acquisition function built on multi-fidelity Bayesian optimization that efficiently estimates optimal hyperparameter scaling laws through adaptive experimentation using less than one-tenth of the computational budget required by convention...

Zhiliang Chen, S. Ament, David Eriksson et al. · 1 citation
#artificial intelligence Preprint Sep 2026

Evaluating Multimodal LLMs as Generalist Vision-Language-Action Agents for Drone Control: Commanding, Approaching, Tracking and Searching

DronesCATS-Agent, an architecture where the MLLM is a swappable component, and DroneCATS, a benchmark treating the model as the independent variable are introduced, an architecture where the MLLM is a swappable component and DroneCATS, a benchmark treating the model as the independent variable.

Jaewoo Park, Minyoung Lee, Sukmin Seo et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Restrict, Don't Retrain: Inference-Time VLM Guidance for Zero-Shot Aerial Segmentation

A single consumer-grade GPU running a vision-language model (VLM) is used to supply missing guidance on pixel-level segmentation, improving segmentation while producing structured, auditable evidence that drives the result and can be inspected on its own.

Teresa DiMeola, Charles Walter, Hong Xiao · 0 citations
#artificial intelligence Preprint Aug 2026

HBQ: Hierarchical Scaling Block Quantization with Hardware-Efficiency-Aware Design for Accurate LLM Inference

Hierarchical Block Quantization (HBQ) uses large blocks to maximize efficiency and introduces low-overhead significand (SIG) scaling for second-level quantization and compensates for large-block errors more effectively than prior PoT and INT schemes.

Chun-Ting Chen, Dongguang Han, Han-Gyeol Mun et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Latent Recurrent Thoughts: Recurrent Refinement of Proposed Latents for Reasoning with Frozen LLMs

Latent Recurrent Thoughts substantially outperforms prior frozen-decoder continuous-space reasoning methods under an identical decoder, prompt, data, and training budget, and outperforms non-thinking-mode chain-of-thought prompting on the same backbone at a small fraction of its inference compute.

Zhao-Xing Chen, Jie Fu · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.