VOSSA (Voiceprint Optimization for Streaming Speech Architectures), a speaker representation framework that extracts speaker information from intermediate content encoder layers and aggregates using attentive statistics pooling, reduces the need for a separate speaker encoder, and improves F0 dynamics and vowel-discrim...
Mu-Ruei Tseng, Waris Quamer, Ghady Nasrallah et al.· 0 citations
Terminal agents rely on self-verification to assess and correct their solutions as they solve tasks through interaction with command-line environments. Yet how trustworthy such self-verification is remains poorly understood. To investigate this question systematically, we introduce a diagnostic framework that identifie...
Yingfeng Luo, Shaowei Wei, Daixin Wang et al.· 0 citations
A rollout-based training framework that recovers full supervision through two complementary components, Anchor-Label Relabelling (ALR) and In-Rollout Anchors (IRA), that increases greedy accepted length by up to 36.5% over DFlash and consistently outperforms erasing baselines.
Jungseob Lee, Chanjun Park, Sugyeong Eo et al.· 1 citation
We study training LLM judges from natural language feedback, especially for subjective tasks where the verdict depends strongly on which evaluation criteria the judge invokes and how it weighs them. The dominant approach, outcome-supervised RL (e.g., GRPO), credits every token in the rollout with a single scalar determ...
Ilgee Hong, Chang-Long Yu, Zhenghao Xu et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Constantly evolving real-world knowledge necessitates models to be updated continuously. Especially in medicine, as clinical evidence changes over time, outdated knowledge can pose safety risks. Existing evaluations of knowledge integration focus on factual recall, offering limited insight into whether newly integrated...
Lukas Thede, Yash Kumar Atri, David Chen et al.· 0 citations
Language models increasingly use architectures that vary attention span and positional encoding across layers, such as applying RoPE with sliding-window attention and NoPE with global attention (SWA NoPE). However, how these choices shape in-context retrieval remains unclear. To study this question, we take a mechanist...
Representing scientific papers as points in a space lets us search for similar papers and inquire about how fields relate to one another and drive innovation. Beyond search, the vector space of papers invites generation: mixing papers through simple vector operations creates new points, mirroring combinatorial novelty,...
Chand Sahil Mansuri, Joel Zachariah, Sadamori Kojaku· 0 citations
The performance ceiling of an LLM team is constrained not only by individual model capabilities, but also by inter-member error resonance and predictive differences. Although heterogeneous teaming is often observed to be effective in practice, existing approaches lack complementarity metrics that are computable, interp...
Liang-Yu Teng, Heng-Song Liu, Jun-Cen Guo et al.· 0 citations
Retrieval-augmented generation (RAG) can ground large language models in external evidence, but retrieved context does not guarantee that generated claims are factually supported. This problem is especially relevant in multi-hop RAG, where retrieval and reasoning proceed through multiple dependent stages. We study whet...
Tamazight (Amazigh) is, together with Arabic, one of the two official languages of Morocco, yet it remains severely under-resourced for speech technology: pub licly available labelled audio is scarce, generally lacks information on the regional variety spoken, and is often of uneven transcription quality. This article...
M. Chadi, Ezzahra Ait El Arbi, Ismail Khayoub et al.· 0 citations
System prompts are the primary lever practitioners use to control language model behavior, yet what they actually do to the computation inside the transformer remains poorly understood. Across 17 instruction-tuned models spanning 8 architecture families and 1.5B to 72B parameters, we use Centered Kernel Alignment (CKA)...
Multimodal large language models (MLLMs) are rapidly advancing clinical diagnosis, yet their adaptation pipelines remain anchored to accuracy-based objectives. Clinical data are heavily class-imbalanced: a constant-majority predictor can score above 90% accuracy while being clinically useless. We therefore evaluate and...
Tian Xia, Minghao Liu, Yiqing Liang et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.