small language model

Projective Shannon Sketches for Transformer KV Memory: Needle Rescue under Compressed Keys on GPT Model

Projective KV-Cache: Slashing LLM Memory Costs by 50%–75% Without Context Amnesia (Empirical Validation on GPT-2) The Executive Problem: Large Language Models (LLMs) processing long documents face an expensive bottleneck: the Key-Value (KV) Cache. Storing every token's attention memory in GPU VRAM creates immense hardw...

Projective Shannon Sketches for Transformer KV Memory: Needle Rescue under Compressed Keys on GPT Model

Projective KV-Cache: Slashing LLM Memory Costs by 50%–75% Without Context Amnesia (Empirical Validation on GPT-2) The Executive Problem: Large Language Models (LLMs) processing long documents face an expensive bottleneck: the Key-Value (KV) Cache. Storing every token's attention memory in GPU VRAM creates immense hardw...

Artificial intelligence in non-small cell lung cancer: transforming diagnosis, treatment, and prognostic evaluation

Non-small cell lung cancer (NSCLC) is characterized by profound biological heterogeneity, frequently leading to late-stage diagnosis, recurrence, or metastasis. Conventional clinical pathways heavily depend on subjective visual interpretations, invasive tissue biopsies, and experience-based medical models that constrai...

What Is the Best AI Voice Recorder for Lectures?

Whether you're attending university classes, online courses, seminars, or professional training sessions, having a reliable way to capture every detail is essential. Many students are now looking for the best AI voice recorder, a lecture recorder and note taker, or simply a good voice recorder that can do more than rec...

Bencmarking Generative AI for Debugging Support in Program Education

Abstract—Programming activities, such as automatic debugging and program repair, are increasingly being supported by Generative Artificial Intelligence (GenAI). However, a rigorous empirical evaluation of the efficacy of various large language models (LLMs) across several debugging phases is necessary. Using a benchmar...

Fine-tuning small reasoning models for quantum field theory

Abstract Despite the growing application of large language models (LLMs) to theoretical physics, there has been little academic exploration of how domain-specific physics reasoning ability develops during training. To investigate this, we perform the first academic comparison of reinforcement learning and supervised fi...

Can a Small Model Learn to Look Before It Leaps? Dynamic Learning and Proactive Correction for Hallucination Detection

Solving the Needle-in-a-Haystack Problem in Mammography Vision-Language Model with Differentiable Subset Sampling

TopKSigLIP outperforms existing open-source mammography and general medical VLMs on both internal and external benchmarks on density assessment, BI-RADS classification, finding subtyping, and cancer prediction under zero-shot evaluation.

Large-Language Models as a Cognitive Virus

This work proposes that their diffusion can be understood through a viral analogy, with LLM use spreading through populations, becoming embedded in cognitive and cultural practices, and highlights how LLM adoption may involve nonlinear collective transitions with important consequences for cognitive autonomy.

HypRQ-VAE: Hyperbolic Item Indexing for Long-Tail-Aware Generative Recommender Systems

Hyperbolic Residual-Quantized Variational AutoEncoder (HypRQ-VAE), the first framework to learn item indexing in hyperbolic space, is introduced, which significantly improves the performance of recommendation, particularly in recommending tail items.

Efficacy of Probiotic Supplementation for Preventing Pediatric Urinary Tract Infections: A GRADE‐Based Dose–Response Meta‐Analysis

ABSTRACT Background and Aims Probiotic supplementation has been proposed as a non‐antibiotic strategy for preventing urinary tract infections (UTIs) in children, but its efficacy remains uncertain. We evaluated the effects of probiotic supplementation on pediatric UTI incidence or recurrence, explored potential dose–re...

Universal Flow and Shear: A Model of Cosmic Motion

The universe moves. Not just galaxies drifting apart — everything, at every scale, is in directional flow through a physical substrate that fills space. That substrate is not empty. It has mechanical properties: resistance, shear, compression, and flow gradients. This paper presents a unified model — the Unified Substr...