On-policy distillation (OPD) strengthens language-model reasoning, yet whether students acquire new factual knowledge or compositional skill for multi-step reasoning remains unknown. We separate these capabilities using a controlled synthetic framework that measures the student's initial capabilities and independently...
Large language models (LLMs) are increasingly used for emotional support, raising concern that sustained use may draw users away from their real-world relationships. Yet existing evaluations primarily focus on the safety, empathy, or helpfulness of responses, leaving under-examined a relational question: where does the...
Shivam Shukla, Jihye Kim, Shubham Gaur et al.· 0 citations
There are more than 2,000 listed companies on the UK's London Stock Exchange, divided into 11 sectors who are required to communicate their financial results at least twice in a single financial year. UK annual reports are very lengthy documents with around 80 pages on average. In this study, we aim to benchmark a vari...
Nadhem Zmandar, Mo El-Haj, Paul Rayson· 0 citations
Goldsmith, an agentic pipeline that turns a small gold set---expert-annotated calibration examples representing the intended task boundaries---into a reusable structured annotation definition, shows that scarce expert supervision can support both task-definition learning and scalable annotation.
Yi-Han Li, Han-Yi Zhang, Xiao-Xi Jiang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
A benchmark study of transformer-based models for detecting rhetorical form and persuasive intent in Bangla political discourse and provides initial benchmark baselines for Bangla rhetorical and persuasion-aware political discourse analysis and highlights the need for context-aware and multi-label modeling.
When an LLM answers a state-specific policy question wrongly, it may be hallucinating, or it may be returning a real value that holds in another state. We test this with a minimal-set design: the question wording is fixed and only the jurisdiction varies, across the 50 U.S. states and the District of Columbia (51 juris...
As text-to-SQL systems move beyond demonstrations toward real-world deployment, ambiguity in user questions becomes a primary source of errors. Such ambiguities are often subtle, domain- or data-specific, and can silently cause system outputs to deviate from the user's true intent. Ambiguity is traditionally addressed...
Yi-Hao Hu, Yan-Lin Feng, Naoki Otani et al.· 0 citations
Mixture-of-Experts (MoE) layers replace the feed-forward block of a Transformer with E expert networks, and each token is routed to k of these experts. Under expert parallelism (EP) the experts are distributed across GPUs, and every MoE layer runs all-to-all collectives in the forward and backward passes to dispatch to...
Radha Gulhane, Quentin Anthony, Beren Millidge· 0 citations
P pseudo-dialect speech is synthesized by converting LLM-generated dialect text via a standard-language TTS model, requiring zero real dialect speech, and intermediate standard-text prediction during training is introduced during training, acting as semantic normalization for downstream tasks.
Shunsuke Mitsumori, T. Mizumoto, Yusuke Fujita· 0 citations
It is shown that emotion is linearly decodable from Moshi's residual stream, but activation steering is only partially achievable, and unevenly so; as happy, angry and surprise steer towards a shared direction while sad is distinctly steerable.
Emo-Jev, a training-free framework with two complementary implementations that decomposes classification into task-specific atomic judgments and composes their probabilities into a final prediction, is introduced.
Small-data adaptation can improve speech detection while degrading speaker attribution. We study this discrepancy in a released streaming diarizer adapted on 7.5 h of two-party conversation and evaluated across six corpora. Adaptation substantially improves in-domain diarization performance and transfers to an independ...
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.