Skip to content

Category

small language model

3,629 papers

#machine learning Preprint Sep 2026

Variational Quantum Transformer Architecture for Synthetic Language Generation

We propose a compact NISQ-compatible quantum transformer architecture for synthetic QNLP sequence modelling. The model preserves the autoregressive next-token interface of a classical transformer, but replaces attention and feed-forward sublayers with variational quantum encoder blocks, connector circuits, decoder bloc...

Julian Hager, Michael Kölle, Gerhard Stenzel et al. · 0 citations
#machine learning Preprint Sep 2026

Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulation

A metric interaction framework that models object-level and scene-level interactions in physical Cartesian space at a shared metric scale and improves diverse VLA and WAM baselines with a small number of additional parameters and training steps is introduced.

Li-Jie Wang, Zheng Lu, Yi-Ming Wang et al. · 0 citations
#machine learning Preprint Sep 2026

Bias Amplification in Multi-Agent Network: How Biased Agents Shape Opinions and Rhetoric

Large language models (LLMs) are increasingly deployed in applications involving interaction between agents, where their output plays a role in collective reasoning and decision-making processes. Despite significant research into the functioning of LLMs in such multi-agent systems, the processes of bias propagation in...

Omran Berjawi, G. Fenza, Rida Khatoun · 1 citation
#machine learning Preprint Sep 2026

Long-Context Demonstration Selection Using State Space Models

We study the problem of demonstration selection, which involves selecting a subset of examples for prepending to a query to a language model. This problem is closely related to in-context learning and language model inference. Since the inference cost of a transformer model scales quadratically with sequence length, th...

Zi-Niu Zhang, Zhen-Shuo Zhang, Ruoxuan Xiong et al. · 0 citations
#artificial intelligence Preprint Sep 2026

A Zeroth-Order Paradigm for LLM Preference Alignment

This paper proposes and analyzes Comparison-based Preference Optimization (ComPO), a zeroth-order alignment method based on comparison oracles, and establishes a convergence guarantee for its basic offline scheme under smoothness, gradient sparsity, and compatibility between the oracle and a latent objective.

Peter Chen, Xi Chen, Wo-Tao Yin et al. · 0 citations
#artificial intelligence Preprint Sep 2026

ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models

This work introduces physical rank consistency (PRC) to measure how well tokenization preserves local physical distance rankings after reconstruction, and presents ActionPiece, which preserves physical action relationships through joint supervision of representation learning and quantization.

Shijie Lian, Bin Yu, Zhao-Long Shen et al. · 1 citation
#artificial intelligence Preprint Sep 2026

Scaling Articulated Rationales for MLLM-based Recommendation

These findings establish articulated rationales as a useful complement to behavioral and content signals, and demonstrate a practical role for MLLMs in scaling sparse human explanations into preference information that improves industrial recommendation.

Hao-Ke Xiao, Yue-Yang Liu, Yu-Hui Zhang et al. · 0 citations
#small language model Open access Sep 2026

Understanding Public Attitudes Towards Immigration Through Online Social Media

Immigration is one of the most politically salient and emotionally charged issues in contemporary public life, shaping debates about national identity, belonging, economic change and social order. Social media platforms have become central arenas in which these debates unfold, allowing immigration-related claims, fears...

Andrea Pio Nasuto · 0 citations
#small language model Open access Sep 2026

**A Multidisciplinary Investigation into the Promise, Challenges, and Policy Imperatives of Artificial Intelligence in India — Integrating the Perspectives of Industry Leaders Anand Mahindra and Nandan Nilekani with Contemporary Debates on Ethics, Inclusion, Sovereignty, and Sustainable Technological Development** ---

--- ## Alternative Titles 1. **The New Electricity: Artificial Intelligence as Protector of Future Welfare — An Analytical Study of AI Adoption in India** 2. **AI as Rakshak: Examining the Transformative Promise, Ethical Challenges, and Policy Imperatives of Artificial Intelligence in the Indian Context** 3. **From Thr...

Sudhakar Geruganti · 0 citations
#small language model Open access Sep 2026

Context-Aware LLM-Guided Neighbourhood Search for Simulation-Based Production Scheduling

The paper presents a novel large language model-based neighbourhood search method for production scheduling using discrete-event simulation (DES) as the modelling and evaluation engine. The combination of large language models (LLMs) and DES represents a relatively new area of research with significant potential. The c...

Róbert Skapinyecz · 0 citations
#small language model Open access Sep 2026

PREreview of "What Does an LLM Learn from Reinforcement Learning? A Mechanistic Interpretability Perspective with Fixed-SAE Track"

This Zenodo record is a permanently preserved version of a PREreview. You can view the complete PREreview at https://prereview.org/reviews/22775771. Summary The authors tackle a real obstacle in interpretability: you can't compare SAE features across training checkpoints, because separately trained dictionaries assign...

Sneh Pankajbhai Vora · 0 citations
#small language model Open access Sep 2026

FinRL-DeepSeek Revisited: A Reproduction and Multi-Seed Robustness Analysis of LLM-Infused Risk-Sensitive Trading Agents

We reproduce and extend FinRL-DeepSeek (Benhenda, 2025), a trading framework combining Proximal Policy Optimization (PPO) (Schulman et al., 2017), Conditional Value-at-Risk (CVaR) constraints (Rockafellar and Uryasev, 2000), and large language model (LLM) signals extracted from financial news. Using the Nasdaq-100 univ...

Viany Arnold MBOUYOM LEUMALE · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.