Many automated decisions in education involve choosing from a fixed set of options: assigning a rubric score, checking whether an answer meets a marking criterion, or identifying the first wrong step in a solution. Generative language models are increasingly used to make these decisions, but their responses require par...
Retrieval-augmented generation (RAG) can expose language models to misleading evidence in retrieved documents. We investigate whether increasing the number of mutually agreeing poisoned documents affects a model's ability to detect misinformation. We evaluate 200 randomly selected questions from SciFact (random seed 38...
Mehrdad Ghassabi, Audrina Ebrahimi, Zahra Zojaji et al.· 0 citations
When a language model invents a Qur'anic verse or hadith, it gives false authority to text that readers may treat as sacred. Existing Islamic hallucination benchmarks are largely Arabic and often closed-ended, while Bengali resources mainly study general-domain hallucination or factual knowledge. We introduce BILAL-BEN...
A convenient shortcut reads sufficiency off the relevance judgments and treats a context without gold documents as unanswerable, and is released, and recommended scoring refusals against content labels, not the presence of gold.
Ivan Kochergin, Vasily Konovalov· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Human preferences change over time: an established preference may remain valid over time, become uncertain as context shifts, or be explicitly revised. Effective personalization requires conversational AI to adapt its response strategy to evolving preferences rather than relying on passive memory retrieval. We formaliz...
Priyanka Dey, Rajarshi Das, Vikas Bahirwani et al.· 0 citations
Automated red teaming trains an attacker large language model (LLM) to elicit harmful responses from a victim LLM, but reinforcement learning can collapse attackers onto a narrow set of prompts when attack success is the only reward. Such a collapse of attack diversity can bias safety evaluation toward repeatedly testi...
Jialin Song, Xiaodong Liu, Weiwei Yang et al.· 0 citations
Fairness benchmarks for large language models (LLMs) are overwhelmingly English-born and American in their social categories; translated versions carry those categories into societies where they do not apply, and almost none fix their hypotheses before the models are run. We present Qistas (Arabic qistas, "the just bal...
Nawar S. Alseelawi, Mustafa S. Aljumaily· 0 citations
This work introduces Expected Harm, a metric that weights the severity of a jailbreak by its execution likelihood, modeled as a function of execution cost, and demonstrates that this miscalibration creates a vulnerability that increases the attack success rate of existing jailbreaks by up to $2\times.
Yen-Shan Chen, Zhi Rui Tam, Cheng-Kuang Wu et al.· arXiv.org· 5 citations
Heads of Security (HoS), a prompt injection defense that enforces instruction-data separation via a small set of learned per-head attention gates, is introduced and shows that prompt injection robustness can be achieved and improved through targeted attention interventions.
Igor Shilov, Xiao-Xue Yang, Alexander Panfilov et al.· 0 citations
Speculative decoding accelerates autoregressive generation by having a draft propose tokens that a target verifies in parallel. Frontier models increasingly ship a built-in Multi-Token-Prediction (MTP) draft head, assumed to be cheap beside verification. A shipped full-attention MTP head can become disproportionately e...
Large language model (LLM) agents -- LLMs that dynamically interact with an environment over long horizons -- have become an increasingly important area of research, enabling automation in complex tasks involving tool-use, web browsing, and dialogue with people. In the absence of expert demonstrations, training LLM age...
Joey Hong, Kang Liu, Zhan Ling et al.· 0 citations
A Latent Reasoning framework in Continuous space (LARC), which alleviates the token-level bottleneck by reasoning over continuous hidden states and achieves state-of-the-art performance on GenEval and demonstrates clear test-time scaling behavior.
Byungwoo Jeon, Yoonwoo Jeong, Hyunseok Lee et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.