Skip to content

Category

artificial intelligence

19,710 papers

#artificial intelligence Preprint Open access Oct 2026

Implicit Reasoning in Transformers: Bridging the Compositionality Gap in GPT-2-like Models

Compositional generalization remains a persistent limitation of transformer language models: even when a model learns to combine known facts correctly in-distribution (ID), the same compositional mechanism may fail when applied to out-of-distribution (OOD) knowledge. We investigate this compositionality gap in a contro...

Davide Venuto, Leonardo Venuto · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Assessing feature scorer results on high-dimensional datasets with t-SNE

While vast literature on high-dimensional data visualization is available, there are not many works regarding the visualization of feature scorers and their results. Feature scorers are algorithms that assign numerical importance to each feature of multi-dimensional datasets. These importance scores can be used in seve...

Bruno Iochins Grisci, Mario Inostroza-Ponta, M\'arcio Dorn · 0 citations
#artificial intelligence Preprint Oct 2026

Rethinking GFlowNet Training: Negative Reinforce Dynamics

This paper establishes a connection between the full gradient and min-min dynamics between the GFlowNet and a decoupled sampler, showing that the sampler reduces observed violations by avoiding high-error regions.

Pedro Dall'Antonia, Daniel Csillag, Diego Mesquita · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Benchmarking Graph Neural Networks for AC Power Flow: The Role of Inductive Biases and Physical Constraints

Fast and accurate models for AC power flow (ACPF) are increasingly important as modern electrical grids require more frequent system analyses. Graph neural networks (GNNs) naturally exploit electrical grid topology, yet the effects of architectural design choices on predictive performance remain poorly understood given...

Federico Clerici, Ferran Bohigas-Daranas, Hamid Latif-Mart\'inez et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Why Speculative Decoding Works Better Than Predicted on Sparse MoE Models

Speculative decoding (SD) accelerates autoregressive inference by leveraging the memory bound nature of decoding, verifying multiple draft tokens in a single forward pass. For mixture-of-experts (MoE) models, prior work predicts a concave speedup-batch size relationship, with gains peaking at intermediate batch sizes d...

Ekagra Ranjan, Komal K. Teru, Bharat Venkitesh et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

TableTune: Measured, Self-Correcting Draft-Length Tables for Dynamic Speculative Decoding

Speculative decoding speeds up large language model (LLM) serving only while the GPU has spare compute, so the best draft length, the number of tokens a small drafter guesses per step, shrinks as the batch grows. vLLM lets operators set the draft length for each batch size with a hand-written table, but nothing measure...

Abhishek Malvankar, Paul Castro, Nick Mitchell et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

MAS-Loop: Beyond One-Shot Orchestration towards Self-Evolving Multi-Agent Systems

Training-time multi-agent system (MAS) design seeks to learn reusable orchestration policies, yet prevailing approaches remain largely one-shot: an Orchestrator generates a system but only observes and learns from its terminal outcome. This paradigm discards execution trajectories that expose system-level failures and...

Hehai Lin, Qi Yang, Chengwei Qin · 0 citations
#artificial intelligence Preprint Open access Oct 2026

TrussTutor-Bench: Benchmarking large language models on solution accuracy, sycophancy, and error detection in statics

Large language models (LLMs) have rapidly become a default source of help for students in science and engineering courses. In foundational engineering mechanics courses such as statics, students routinely use these tools to check answers, work through partial solutions, and ask for explanations. Effective tutoring in t...

Evangelos Apostolakis, Erfan Hamdi, Sara Jahedazad et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Lev-3B: A Data Recipe for Compact Probabilistic Log Decision Models

Many log-analysis tasks involve choosing among known options, such as detecting anomalous sessions or identifying attack techniques, and benefit from calibrated probabilities. We present Lev-3B, an open 3B-parameter decision model built on Granite-4.1-3B-Base with a shared pointer readout, and study its training recipe...

Leo Betthauser, Yingqi Liu, Uday Shah et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Interventional Training Reduces Causal Bypass in In-Context Introspection

Introspection, the ability of a system to access and reason about its internal signals, is crucial for language model (LM) self-consistency and scalable interpretability. Prior work argues that LMs possess introspective capabilities, and that training (SFT) could enhance such behavior. However, most setups leave open t...

Zilu Tang, Jongin Kim, Kerem Sahin et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

FlipJev: Fast Black-Box Red Teaming Finds Universal Adversarial Suffixes for Typed Decision Models

Typed decision models are an emerging class of language models that make decisions instead of generating free-text responses. They answer in a single fast and cheap query and are increasingly used, including in security-sensitive tasks. However, red teaming of these models leaves two gaps: existing adaptive attacks do...

Xiaogeng Liu, Xinyan Wang, Chaowei Xiao · 0 citations
#artificial intelligence Preprint Oct 2026

Autonomous Quantum Measurement with Agentic AI

QUANTA is established as a generalizable framework for evidence-driven, safeguarded and closed-loop quantum-materials characterization through transport measurements of the topological Weyl semimetal TaP, as well as investigations of nonlinear responses in magnetic material Co2MnGa.

Eunbi Rha, Abhijatmedhi Chotrattanapituk, Mou-Yang Cheng et al. · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.