Skip to content

Category

small language model

3,243 papers

#small language model Open access Oct 2026

Berna R7 v3: A 1.2B Language Model with Self-Growing Cell Architecture

We present Berna R7 v3, a 1.2B-parameter language model trained from scratch using the DNA-Kernel Plexus architecture — a novel approach in which neural capacity is allocated through dynamic, self-growing "cells" guided by a six-dimensional knowledge vector. Trained on 2.66B tokens (English, mathematics, and code) over...

Muhamed Kamil · 0 citations
#small language model Review Open access Oct 2026

Nutritional interventions in patients with heart failure and malnutrition: a systematic review and meta-analysis of randomized trials

REGISTRATION TIMING This record was created after the review was completed and is a retrospective registration. The review was not prospectively registered. The literature search was executed on 4 October 2026, and study selection, data extraction, risk-of-bias assessment and the meta-analyses were completed before thi...

Alberto Esteban‐Fernández, José Ángel Pérez-Rivera, Juan L. Bonilla‐Palomas et al. · 0 citations
#small language model Review Open access Oct 2026

MOLECULAR-MORPHOLOGICAL DISSOCIATION IN VITRIFIED-WARMED HUMAN EMBRYOS: RETHINKING EPIGENETIC RISK BEYOND MORPHOLOGY

Although vitrification has transformed assisted reproductive technology, it occurs during a critical developmental window characterized by extensive epigenetic remodeling and transcriptional recalibration; freeze-thaw procedures expose gametes and embryos to osmotic, cryoprotectant, oxidative, and mitochondrial stress,...

Pelin Coştur Filiz, S. Filiz · 0 citations
#small language model Open access Oct 2026

From Messy Country Names to ISO 3166 Codes: A Small Model That Abstains, and When a Lexicon Is Enough

Company registers and forms record countries as free text: in any language, misspelled, abbreviated, historical, or not a place at all. CountryCode-Decide is a 74.7 MB open model (mmBERT-small, two heads, 8-bit ONNX) that maps such a string, read with its field and register, to an ISO 3166-1 alpha-2 or ISO 3166-2:US co...

Ali Ildan · 0 citations
#small language model Open access Oct 2026

WHO PAYS FOR THE KNOWLEDGE MODELS COPY? MODEL COLLAPSE AS ROGERS' PARADOX

Generative models trained on the output of earlier models lose knowledge across generations, rare knowledge first. The remedies that work all bring in information from outside the loop – fresh human data, verifiers, curators – and the theory of model collapse treats that supply as given: a fixed archive, drawn from a f...

Nam Do-Hoang Le · 0 citations
#small language model Book Open access Oct 2026

Beyond Topic Matching: Goal-Conditioned Evaluation of Research Contributions in ETD Collections

Evaluating whether scholarly research contributes to a Sustainable Development Goal (SDG) requires an interpretive framework that combines the goal definition, its targets, contribution criteria, and the document itself. Instruction-tuned large language models can instantiate this framework in context, producing a cons...

William A. Ingram, Edward A. Fox · 0 citations
#small language model Book Open access Oct 2026

Selective Circuit Preservation During Compression of Large Language Models for Edge Deployment

This dissertation asks whether compression can be made capability-aware by borrowing the unit of analysis from mechanistic interpretability, and presents the problem formulation, the gap identified in a targeted review of the compression and interpretability literatures, and the design of a first experiment measuring c...

Farshad Ghorbanishovaneh · 0 citations
#small language model Book Open access Oct 2026

Research Data-Sharing Practices Through the Lens of Data Availability Statements

This study examined the relationships between Data Availability Statement (DAS) categories, citation counts, and the evolution of research data-sharing practices. We analysed 653,490 research articles published between 2010 and 2025 in the ten open-access journals with the most DAS-containing articles, using PubMed Cen...

Hiroyuki Tsunoda, Yuan Sun, Masaki Nishizawa et al. · 0 citations
#small language model Book Open access Oct 2026

Real-Time, Context-Specific Educational Metadata Enrichment of Learning Resources on the Web

Web resources rarely carry the educational metadata that teachers use to judge whether a resource fits their lesson, and dedicated educational repositories that do carry it cover only a fraction of what teachers find through web search. Closing this gap in real time, at the point of search, requires classifiers that ar...

Ratan J. Sebastian, Anett Hoppe · 0 citations
#large language models Book Open access Oct 2026

The Decomposition Dilemma: When Do Multi-Agent LLM Workflows Help Grounded Knowledge Generation?

Large Language Model (LLM) workflows increasingly decompose knowledge-intensive generation into planning, role assignment, subtask execution, and synthesis. Although this structure may support specialization, it also adds coordination and computational overhead. We present a preliminary task-level comparison of a Direc...

A. Hossain, M. Chowdhury, Shafayet Nur et al. · 0 citations
#small language model Book Oct 2026

From Digital Library Records to Trust-Grounded Virtual Experts for Knowledge Retention

Long-lived technical organizations depend on senior subject matter experts whose knowledge is only partially preserved in reports, publications, and archival metadata. Digital libraries preserve those records, but they rarely provide centralized, expert-scoped, question-answering access to the knowledge of people who l...

James Ecker, Jian Wu, B. D. Allen et al. · 0 citations
#large language models Book Open access Oct 2026

Evaluating and explaining LLM classification for automatic screening in Systematic Reviews

Evidence synthesis methods, such as systematic reviews (SR), require research teams to find, select, evaluate, and synthesize all available evidence to answer a specific research question in a reproducible and transparent, bias-reduced manner. Early in the process, teams must screen all unique titles and abstracts gath...

Min-Ji Kang, Bipasha Banerjee, C. Comer · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.