Skip to content

Category

small language model

3,629 papers

#natural language process... Preprint Aug 2026

AI Writers Have a Consistent Stylometric Footprint, but AI Editors Do Not

It is shown that AI generation leaves a consistent ``stylometric footprint'': a small subset of features, primarily entropy and lexical diversity, consistently separates AI-generated text from human writing across 8 LLMs and 5 domains, while the remaining features depend heavily on the domain and generator.

Zhengyang Shan, Yukyung Lee, Sophie Hao · 0 citations
#natural language process... Preprint Aug 2026

Speculative Probing: LLM Monitoring at Speculative-Decoding Cost

It is found that the speculative-decoding module in recent LLMs can be repurposed for efficient high-quality classification by appending a trained soft prompt at the end of the target sequence, which can repurpose the speculative-decoding module into a sequence classifier.

Collin Zhang, Tingwei Zhang, Vitaly Shmatikov · 0 citations
#small language model Preprint Aug 2026

Training-Free Temporal Abstraction for General Video Understanding

STITCH is presented, a training-free method that divides a video into semantically meaningful temporal chunks that are computed once per video and reused across tasks, suggesting that reusable temporal abstraction is a promising direction for general video understanding.

Etienne Casanova, S. Brodjian, Pietro Perona · 0 citations
#small language model Preprint Aug 2026

NumBench: Diagnosing Counting Failures in Text-to-Image Models

The Confidence-Weighted Numeric Precision Score (\cwnps), which aggregates three calibrated detectors and discounts uncertain proposals, is proposed for scalable evaluation and developed a process model in which requested instances compete for a finite set of resolvable image regions.

Sandeep Wadhwa, M. Vatsa, Richa Singh et al. · 0 citations
#small language model Preprint Aug 2026

Biologically Inspired Mechanisms for Facilitating Grokking in Multilayer Perceptrons

The results support the common principle that explicit regulation of neuron utilization and effective connectivity can improve the emergence of generalizable internal computation and motivate broader investigation of biologically inspired activity regulation and adaptive sparsification, including in large language mode...

Florin Leon · 0 citations
#small language model Preprint Aug 2026

From Documents to Reasoning: A Validated Synthetic Data Pipeline and Semantic-Aware Fine-Tuning for Financial Numerical Reasoning

This work proposes a comprehensive pipeline for improving financial QA systems through high-quality synthetic data generation and fine-tuning of smaller language models (SLMs) using Quantized Low-Rank Adaptation (QLoRA).

Lokendra Birla, Milind Savagaonkar, Visnu Srinivasan et al. · 0 citations
#small language model Preprint Aug 2026

uMOF: A Universal Database, Benchmark, and Machine Learning Interatomic Potentials for Metal-Organic Frameworks

Foundation machine learning interatomic potentials (MLIPs) deliver near-ab-initio accuracy at a fraction of the computational cost, yet their promise for Metal-organic Frameworks (MOFs) remains largely unrealized as large unit cells make first-principles training data expensive to generate, fine-tuned models are scarce...

T. J. Inizan, Prathami Divakar Kamath, Alin M. Elena et al. · 0 citations
#machine learning Preprint Aug 2026

TACIT-Switch: Cost-Aware Model Escalation for LLM Agents from Censored Supervision

This method learns permanent handoff policies from accumulated trajectory evidence and Teacher-Annotated Censored Intervention Times (TACIT) and represents each annotation as an interval-censored observation on a cumulative-risk scale and achieves the highest held-out success among learned policies on both ALFWorld and...

Ji'an Lei, Jian Huang · 1 citation
#small language model Open access Aug 2026

Evaluating teacher-supervised small medical language models for institution-constrained clinical QA.

For institution-constrained clinical QA, in-domain teacher-supervised fine-tuning was the most reliable evaluated adaptation path, and public-benchmark transfer was not a dependable proxy for local utility in the primary internal comparison.

Gao-Yuan Du, D. Dimitriadis, Xue-Ping Li · 0 citations
#small language model Open access Aug 2026

Balancing privacy and performance: the impact of facial defacing on AI in medical imaging

Summary Background Recent NIH Data Management and Sharing (DMS) policy updates and NIH controlled-access data security requirements have increased attention to facial anonymization and controlled-access handling of shared head imaging data. This is particularly relevant for datasets submitted to or hosted by the Cancer...

Yu-Li Wang, Yu-Wei Dai, Haoyue Guan et al. · 0 citations
#large language models Book Jul 2026

Fine-grained Computation-Communication Overlap via Tile-level Signaling and Scheduling for Mixture-of-Experts

This work presents a fine-grained approach that overlaps expert compute with the second all-to-all via tile-level signaling and scheduling, making it practical for improving distributed MoE execution efficiency on multi-GPU systems.

Min-Yu Cui, Anna Wingkvist, Morgan Ericsson · 0 citations · ⚡1
#computer vision Preprint Aug 2026

Trustworthy RAG: An Evaluation Agent for Detecting Misinformation and Knowledge Poisoning in Generative AI Systems

An Evaluation Agent, middleware that combines Natural Language Inference factual verification, a five-signal poison detector with relevance-weighted aggregation, and a Trust Index is proposed, which reliably blocks instruction injection of unsafe advice while contradiction and subtle semantic weakening remain hard.

Balkrishna Giri, M. Hasan, Jussi Rasku et al. · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.