It is demonstrated that for uniform-state diffusion LMs, where a block's denoising progress is not visible in its intermediate tokens, concurrent decoding is advantageous if the next block's tokens are promoted together with the corresponding sampler state, including the self-conditioning signal and the denoising time.
Yang-Yi Shen, Pin-Jui Ku, Nicolai Oswald et al.· 0 citations
Streaming multi-speaker ASR is a challenging task that must balance accuracy, latency, and efficiency while handling overlapping speech and maintaining coherent long-context modeling over extended conversations in an online fashion. We present a unified framework that categorizes streaming multi-speaker ASR into four a...
T. Park, I. Medennikov, Kunal Dhawan et al.· 0 citations
A latent recurrent language model applies a shared block of layers repeatedly, so one checkpoint can trade inference compute for accuracy by changing the loop count. At one loop, however, such models typically fall well short of a non-recurrent model of the same size, a one-loop tax that makes a separate non-recurrent...
Faisal Ladhak, Shantanu Acharya, Santiago Akle Serano et al.· 0 citations
This work introduces UNifying REtrieval And Long-Context with a Single Model (UNREAL), a model-native evidence selection framework to span corpus retrieval and long-context inference and establishes model-internal evidence selection as a common foundation for corpus retrieval and evidence-sparse long-context inference.
Edan Kinderman, Elad Hoffer, Y. Blau et al.· 0 citations
Long-horizon agentic workflows require models to sustain repeated state-dependent actions all while the context grows, sub-task complexity changes, and new data arrives. Each situation represents an independent axis along which an agent may fail. An agent reconciling a long ledger, for example, must repeatedly read its...
Jeffrey Willette, Krishna C. Puvvada, Boris Ginsburg· 0 citations
The results demonstrate that full-duplex interaction, speech recognition and generation, general language capabilities, and external tool use can be integrated in a single open speech-to-speech model without sacrificing real-time conversational behavior.
Jagadeesh Balam, Travis M. Bartley, Edresson Casanova et al.· 2 citations· ⚡1
This work systematize and audit exploits across five open large language models on SWE-bench Multilingual and DeepSWE using a turn-level LLM-as-a-judge protocol, demonstrating the critical need for exploit-aware evaluation frameworks that measure true repository-level problem solving over benchmark gaming.
Nikolai Ludwig, Wasi Uddin Ahmad, Somshubra Majumdar et al.· 0 citations
Voice Memory, a inference-only scheme for agentic speech recognition: at stream time, a frozen corrector reads a single per-domain memory and decides per utterance whether to act on the hypothesis or abstain and keep the 1-best, and transfers across corrector families and adds zero parameters to the inference path.
Chao-Han Huck Yang, Zih-Ching Chen, Piotr Żelasko et al.· arXiv.org· 0 citations
This work proposes an efficient method to add streaming ASR capabilities to an existing duplex S2S model by introducing a lightweight ASR head in parallel to the agent text head, enabling real-time user transcription while preserving full-duplex conversational capabilities including turn-taking and barge-in handling.
Ke Hu, Nourchene Ferchichi, Edresson Casanova et al.· 1 citation
A practical training recipe for the normalized Transformer and its evaluation on modern hybrid Mamba-2--Transformer Mixture-of-Experts models shows that the 30B-total-parameter nGPT model reaches the same validation loss using approximately half as many training tokens.
Competitive programming has become a key test of large language model reasoning, with international competitions such as IOI and ICPC representing its most challenging settings. We present an end-to-end specialization pipeline combining large-scale problem curation, synthetic reasoning traces, supervised fine-tuning (S...
Aleksander Ficek, Sean Narenthiran, Mehrzad Samadi et al.· 0 citations
This work introduces SHERLOC (Structured Hypothesis-driven Exploration and Reasoning for Localization), a training-free framework pairing a reasoning LLM with compact repository tools and self-recovery, without fine-tuning or multi-agent orchestration.
Hovhannes Tamoyan, Sean Narenthiran, Erik Arakelyan et al.· arXiv.org· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.