Skip to content

Category

small language model

3,629 papers

#natural language process... Preprint Sep 2026

LLMs Learn Better In-Context from Rules than from Examples

It is found that models generally learn more reliably from rules than from examples alone, and additional examples on top of rules or simply scaling up the number of examples do not lead to consistent and significant gains.

Xiang Fu, Seungmin Cho, Yukyung Lee et al. · 0 citations
#machine learning Preprint Sep 2026

ALRA: Adaptive Local Relational Alignment for Logit-Based Pre-training Distillation of Autoregressive Language Models

This work proposes Adaptive Local Relational Alignment (ALRA), a position-specific framework combining student proposals with teacher guidance, which replaces the teacher-mass coefficients of the two conditional terms with unit coefficients, preventing either term from being downweighted solely because its region has l...

Quang Hoang Trung, Quang Huu Hieu, Phuc-Thanh Nguyen et al. · 0 citations
#machine learning Preprint Sep 2026

RecurTrace: Adaptive Latent Reasoning with Loop-Time Memory

RecurTrace introduces Loop Memory Attention, which lets each looped layer attend to its own states from previous iterations along the loop-time axis, so the model can revisit earlier computations instead of relying on the latest state alone.

Yu-Xiang Wang, Kun-Yu Feng, Ying-Da Shen et al. · 7 citations
#machine learning Preprint Sep 2026

From Zero to Hero: An Open LLM Ecosystem for Armenian

It is found that the largest public Armenian corpora overlap web-derived evaluation panels heavily, including a train/test self-overlap inside FineWeb-2.0, and that a small share of verified translated STEM data reverses the loss.

Erik Arakelyan, Khatun Avetisyan, M. Davtyan et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Compile by Training: Turning Natural-Language Specifications into Local Neural Functions

Many recurring text functions are easy to describe but difficult to implement with rules, while calling a large remote model for every input introduces repeated cost, latency, and dependency on a provider. We present compile by training, which turns a natural-language specification into a reusable neural function. At c...

Yun-Tian Deng, Peng-Yu Nie, Stuart M. Shieber · 0 citations
#artificial intelligence Preprint Sep 2026

Knowledge Acquisition During Pre-training? Large Language Models Learn Better With Auxiliary Views

Gaps remain in our understanding of how large language models (LLMs) acquire knowledge during pre-training. We posit that auxiliary views, reformulations of knowledge, are causally helpful for learning. We design controlled experiments to isolate this. First, we confirm that repetition is necessary for acquisition and...

Joseph Lee, Yi-Di Huang, Dokyoon Kim et al. · 0 citations
#artificial intelligence Preprint Sep 2026

It's the Problem, Not the Path: Budget and Difficulty Confounds in LLM Reasoning Trajectories

Two restart-controlled truncation probes separate when a solution fits the continuation budget from when a prefix carries value that fresh computation cannot buy, and a pre-registered, difficulty-controlled test finds no detectable outcome information in early-window internal signals beyond a problem-difficulty baselin...

Yigit Utku Bulut · 1 citation
#artificial intelligence Preprint Sep 2026

LLM4CKD: Large Language Models for Early Stage Chronic Kidney Disease Screening

This study evaluates the effectiveness of large language models for CKD screening under zero-shot and few-shot in-context learning settings and compares them with traditional ML and DL methods and proposes a framework that uses clinically selected tabular features and structured prompt templates to enable LLM-based inf...

Muhammad Ashad Kabir, S. Munira · 0 citations
#artificial intelligence Preprint Sep 2026

Synthetic Semantic Supervision for Contrastive Code Representation Learning in Small Transformers: An Empirical Study

Synthetic semantic supervision yields statistically significant gains over pretraining baselines of the same inference-time size on five of eight tasks, with parity on two more; once fine-tuned, it matches or exceeds zero-shot models two orders of magnitude larger on classification, and it stays on par with execution-a...

K. Paulsen, Florian Tambon, Mike Papadakis et al. · 0 citations
#small language model Dataset Open access Sep 2026

User study result and dataset

This record contains the human annotation study underpinning the MSc thesis"Exploring Semantic Consistency in Image Super-Resolution" (Master in ComputerVision, Universitat Autònoma de Barcelona / Computer Vision Center). Super-resolution is normally evaluated on fidelity and perceptual quality — howclose an output is...

Valentin Micu-Hontan · 0 citations
#small language model Open access Sep 2026

HERMES-OT: Hierarchical Embedded Reasoning Models for Predictive Cyber-Physical Defence in Industrial Control Systems

A small-language-model architecture for AI-driven detection, prediction and safe defence of operational technology. Operational technology (OT) and industrial control systems (ICS) increasingly connect information technology, industrial networks, programmable logic controllers (PLCs), SCADA, distributed control systems...

Yasir Musawar · 0 citations
#small language model Open access Sep 2026

A meta-synthesis of the paper “Thinking about your running movement makes you less efficient: attentional focus effects on running economy and kinematics” - Schücker, L. & Parrington, L. (2019).

Meta-Student is a collaborative research platform, coordinated by the Sports Science Replication Centre, that pools independently collected undergraduate research datasets into statistically powerful individual-participant-data (IPD) meta-analyses. Students at multiple institutions each run a small, standardised study...

Joe Warne · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.