Skip to content

Category

natural language processing

9,568 papers

#artificial intelligence Preprint Sep 2026

Kairos: Toward a Byte-Level Foundation Model for Every Modality

Small language models trained on a single local machine leave little room for architectural trial and error. Kairos combines bidirectional gated-DeltaNet linear attention and sliding-window attention over shared projections (LiZAttention2), block-wise Attention-Residual aggregation, a sparse Mixture-of-Experts (MoE) fe...

F. Furfaro · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Studying Comics at Scale with Artificial Intelligence: The PAGE Framework and Three Studies of American Comics and Japanese Manga

Comics are one of the great visual records of the twentieth century: hundreds of thousands of pages in which a mass readership saw its leaders, its wars and its heroes. Most of this record has never been studied as a whole; comics scholarship proceeds one book at a time. We argue that artificial intelligence, including...

Emilio Ferrara · 0 citations
#artificial intelligence Preprint Open access Oct 2026

UkrMeme: Multimodal Explainable Persuasion Detection in Ukrainian Memes

Memes play a central role in modern online communication, especially in contexts of political conflict where visual and textual cues combine to convey persuasive messages. We study persuasive technique detection in Ukrainian memes using vision-language models (VLMs). We introduce UkrMeme, a dataset of 200 organically p...

Nazar Andrushko, Vera Schmitt, Veronika Solopova · 0 citations
#artificial intelligence Preprint Oct 2026

A Privileged Teacher That Only Scores Cannot Search: Critique-Conditioned On-Policy Self-Distillation for Reasoning

On-policy self-distillation promises to replace the sparse outcome signal of verifiable-reward RL with dense token-level credit: a teacher conditioned on the reference solution scores the student's own rollout, and the resulting distributional shift is distilled back into the policy. We investigate whether this scoring...

Mayug Maniparambil, Ayush K. Rai, Ekansh Verma et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Adaptive DHiSparse: Speculative Decoding over a Load-Adaptive KV Hierarchy

Long-context serving runs out of KV memory before the hardware reaches its useful throughput. HiSparse stores history in host memory and fetches only the selected entries, but it uses one cache budget at every load and does not handle draft-model speculative decoding such as DSpark and DFlash2. We present Adaptive DHiS...

Naji Alazhar, Wassel Alazhar · 0 citations
#artificial intelligence Preprint Open access Oct 2026

A Multi-Agent LLM System for Automated Tuning of Specialized Neural Network Models

Many machine learning approaches are two-level: an expert selects a class of methods, within this class the choice of key components is critical and usually manual. This paper addresses the automatic tuning of these components and proposes a framework transferable across models of different nature. The multi-agent larg...

Ivan Moloshnikov, Dmitry Kunitsyn, Alexander Sboev et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Retrieval-Augmented Multimodal Language Model with Heterogeneous Evidence Integration for Clinical Prognosis

Clinical prognosis requires integrating structured measurements, physiological waveforms, longitudinal history, and population context. We introduce PRISM (Population-Retrieved Inference for Structured Multimodal Prognosis), a multimodal language model that combines per-feature numerical tokenization, recency-weighted...

Hamza Shafiq, Jia-Lu Tang, Ting Dang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

BoundaryEvo: Data-Model Co-Evolution at the Capability Boundary for Long-Chain Reasoning Distillation

Distilling long-chain reasoning trajectories from large teacher models provides an effective way to improve the reasoning ability of small language models. However, existing methods typically select a fixed training set before distillation, overlooking that the usefulness of a reasoning example changes as the student e...

Jia-Ming Su, Suorong Yang, Xu-Dong Li et al. · 0 citations
#artificial intelligence Preprint Oct 2026

JANUS: Enhancing Long-Horizon Autonomous Research with Co-Evolving World Models

Long-horizon autonomous research has shown promise in accelerating scientific progress through sustained cycles of hypothesis generation, implementation, and validation. However, this Generate-Execute-Feedback paradigm relies on reactive trial-and-error, where costly and time-consuming executions introduce severe feedb...

Meng-Di Liu, Cheng-Hao Jia, Hong Chang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA

Question answering over large heterogeneous document collections requires first finding the right passages and then reading them, yet current retrieval-augmented agents give one model both kinds of tools and let it schedule itself. We present KnowForge, a pipeline separated by job: a hybrid-retrieval knowledge-point in...

Wenlin Lin, Fanzhe Wei · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Travel Back To Move Forward: Retrospective Exploration and Evolving for Long Horizon Agents

Large language model agents increasingly operate in long-horizon environments where early mistakes can trigger cascading failures and trap agents in dead-end trajectories. Agents must therefore be able to proactively recover from such states and turn their exploratory experience into guidance for subsequent decisions....

Ziang Ye, Wentao Shi, Lei Chen et al. · 0 citations
#artificial intelligence Preprint Oct 2026

EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents

Continual learning requires models to accumulate past experience and transfer it to new tasks. Despite substantial research on continual learning, existing work remains largely confined to non-embodied settings, without extending to embodied environments. To address this gap, we introduce EmbodiedCLBench, the first ben...

Jie Huang, Ya-Nan Chen, Rui-Xun Liu et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.