Verified search, in which a language model proposes programs, a hard evaluator scores them, and selection keeps the best, has recently moved mathematical records; controlled ablations of the proposer-side components remain rare. We instrument a minimal FunSearch-style loop at office scale (a 30B local model on a laptop...
While TTLab's system localizes error spans effectively, classification of rare error types remains challenging, highlighting the need for data augmentation for tail categories.
Ali Abusaleh, Bhuvanesh Verma, Alexander Mehler· Proceedings of The Fourth Ar...· 1 citation
An exploratory, single-seed ablation of TALH (Adaptive Latent Hybrid), a decoder-only language model with parallel Multi-head Latent Attention (MLA) and a custom recurrent state-space (SSM) branch supports implementation-specific hypotheses rather than general conclusions about MLA, SSMs, or mixture-of-experts models.
This work introduces PROOF, a profile-oriented benchmark for factual coverage in instruction-tuned language models, and measures factual coverage as a structured, intervention-aware profile rather than a single claim about what a model believes.
A. Chetvergov, Mikhail Solovev, Timofei Sivoraksha et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This paper examines Pythia and OLMo 2 across 66 pretraining checkpoints, three of the post-training stages of OLMo 2 that have been released, about 90,000 continuations, and four training corpora, and traces the provenance from end to end to show exactly where such descriptions came from.
Deep search requires LLM agents to decompose complex queries, search for evidence, and synthesize grounded answers, yet existing ReAct-style agents suffer from two limitations: role coupling, where one policy must handle planning, evidence use, and synthesis; and context accumulation, where growing search histories int...
Xing-Yu Wu, Yuchen Yan, Zhengxi Lu et al.· 0 citations
This work proposes Agentic-GER, an LLM-based agent for terminology correction in long-form speech, which uses global context from the full transcript to identify suspicious terms and resolve ambiguous hypotheses.
Yan-Qiao Zhu, Wu-Peng Wang, Zhifu Gao et al.· 0 citations
The main findings are that diverse, high-quality SFT establishes a strong capability floor and difficulty filtering keeps RL prompts within a productive learning range, and reward reliability provides a practical principle for ordering stages.
Chia-yuan Chang, Ren-Yuan Cheng, Rui Feng et al.· 0 citations
Science, technology, and innovation policies are crucial for competitiveness, yet their diversity and scale make them difficult to map and monitor consistently. Existing approaches rely heavily on manual survey efforts, which are costly and challenging to scale across countries. Large language models (LLMs) enable new...
Carolyn Cole, M. Deschryvere, Toqeer Ehsan et al.· FLINS-ISKE· 0 citations
Fine-grained meme classification in A2 was the most challenging setting, partly due to sparse labels and train-test distribution shifts, partly due to sparse labels and train-test distribution shifts.
Firoj Alam, Masudul Biswas, Mohamed Bayan Kmainasi et al.· 0 citations
The preamble worsens ten models, moving three out of the band into collapse and one into refusal, yet improves seven whose neutral prompts over-mark: the vulnerability replicates, but its direction is exam-specific.
A. Habibullah, Yazan Alshoibi, M. Alshiekh et al.· 0 citations
Chain-of-thought (CoT) instructions can distort multiple-choice VLM evaluation when a scorer appends a reasoning cue but reads answer-label logits before the model generates any rationale. We call this CoT-prefix scoring. On ScienceQA, Qwen2.5-VL-7B drops from 80.76% to 45.48%, and across five option-content permutatio...
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.