Skip to content

Category

natural language processing

9,261 papers

#artificial intelligence Preprint Open access Oct 2026

Towards robust long-context understanding of large language model via active recap learning

In this paper, we propose active recap learning (ARL), a framework for enhancing large language model (LLM) in understanding long contexts. ARL enables models to revisit and summarize earlier content through targeted sequence construction during continued pretraining and retrospective summarization at inference. First,...

Chenyu Hui · 0 citations
#artificial intelligence Preprint Open access Oct 2026

PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Support

LLMs are increasingly used for mental health support, yet they can produce responses that are overly directive, inconsistent, or clinically misaligned. Most risk mitigation approaches rely on implicit alignment through training or prompting, offering limited runtime accountability. We introduce PAIR-SAFE, a paired-agen...

Jiwon Kim, Violeta J. Rodriguez, Dong Whi Yoo et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Dementia-R1: Reinforced Pretraining and Reasoning from Unstructured Clinical Notes for Real-World Dementia Prognosis

While Large Language Models (LLMs) have shown strong performance on clinical text understanding, they struggle with longitudinal prediction tasks such as dementia prognosis, which require reasoning over complex, non-monotonic symptom trajectories across multiple visits. Standard supervised training lacks explicit annot...

Choonghan Kim, Hyunmin Hwang, Hangeol Chang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

EvalCards: A Framework for Standardized Evaluation Reporting

Evaluation reports guide the use of general-purpose AI (GPAI) models, yet inconsistent reporting often leaves essential questions unanswered. Through a review of prior work, we identify three central issues in evaluation reporting practices today, reproducibility, accessibility, and accountability, and examine how exis...

Ruchira Dhar, Danae Sanchez Villegas, Antonia Karamolegkou et al. · 0 citations
#artificial intelligence Review Oct 2026

EvoSkill v2: Fully Agentic Skill Evolution from Benchmark Adaptation to a Stateful Evolver

EvoSkill v2 is a three-agent system that edits the instructions (skills) an agent is given, leaving its model and harness intact. The user starts a run by describing a benchmark and supplying a grader, which a benchmark adaptor turns into a benchmark-specific plugin. A solver attempts the tasks, and an evolver reads th...

Da-Wei Huang, Baran Nama, Salaheddin Alzubi · 0 citations
#artificial intelligence Preprint Open access Oct 2026

JANUS: Foreseeing Latent Risk for Long-Horizon Agent Safety

Agent safety is moving from content moderation toward preventing operational failures before tool-using agents act. We propose Janus, a foresight-oriented framework for long-horizon agent safety that trains guards to anticipate delayed risks from partial trajectories. Janus synthesizes diverse agent trajectories via mu...

Yuan Xiong, Linji Hao, Shizhu He et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

AlphaMemo: Structured Search-Process Memory for Self-Evolving Alpha Mining Agents

LLM agents are promising for alpha mining via combining financial priors, symbolic reasoning, executable factor generation, and feedback-driven refinement. Yet, they face a combinatorial search space, noisy non-stationary feedback, redundant discoveries, and overfitting risks from naively reusing past successes. To add...

Hang Yu, Zifan Zheng, Chun Gan et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

SkillPyramid: A Hierarchical Skill Consolidation Framework for Self-Evolving Agents

Recent AI agents can flexibly invoke skills to solve complex tasks, but their long-term improvement is fundamentally constrained by a lack of systematic skill construction, accumulation, and transfer. In particular, without a unified framework for skill consolidation, agents tend to redundantly construct similar capabi...

Yuan Xiong, Ziqi Miao, Qian Chen et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Yalda-Embedding: Open Development of a Competitive Persian Retrieval Model

Yalda Embedding, a 595.8-million-parameter Persian retrieval model adapted from Qwen3-Embedding-0.6B, is presented, a 595.8-million-parameter Persian retrieval model using more than one million query-document pairs and achieves the highest macro-average among the evaluated 0.6B models.

Yalda Taheri, Mohammad Hassan Heydari, Armon Rasooli · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Interpretable sparse fine-tuning with TopKLoRA enables faithful circuit discovery

Fine-tuning on datasets of unknown origin can create a backdoor in the trained model when the data includes poisoned examples. Difficult to localise and remove, backdoors can persist through safety training. While parameter-efficient fine-tuning methods capture the full parameter changes introduced during training, the...

Marek Masiak, Andrzej Szablewski, Nicola Cancedda et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Multiplicative vs. Additive State Coupling in Learned Optimizer Schedules

We learn schedules for a continuous penalty relaxation of MAX-CUT by backpropagating through an unrolled classical solver. A state-blind schedule generalizes to instances substantially larger than those used for training. A state-adaptive bilinear schedule also generalizes out of distribution, outperforming its untrain...

M. Harper Langston, Pierre-David Letourneau, Dalton Jones et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Every Edge Needs a Quote: Building a Quote-Grounded Knowledge Graph of Healthcare Software Adoption with Language-Model Agents

Hospitals regularly buy software that clinicians and patients depend on. Because these purchases are costly, hard to reverse and can affect patient care, buyers look for evidence of which peer institutions already use a product and which systems it connects to. This evidence is public but scattered across vendor websit...

Juan Felipe Duran, Arthur Tobler, Martin Valli\`eres · 0 citations

From tech blogs

See all →
Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.