Existing agent benchmarks typically evaluate agents on well-specified tasks defined by issue reports, specifications, or task tickets. Real-world customer delivery is different: forward-deployed engineers (FDEs) must clarify ambiguous requirements, work in live systems, and uncover unstated constraints. We introduce FD...
Dongxu Yang, Hongda Yan, Renxin Wang et al.· 0 citations
Large language models (LLMs) are expanding from assisting scientific research and engineering to autonomously developing and improving AI systems, advancing AI for AI (AI4AI) as a pathway toward recursive self-improvement (RSI). Workflow-driven machine learning engineering (MLE) systems provide a practical path toward...
Shangheng Du, Jin-Xin Shi, Shuai-Yu Zhang et al.· 0 citations
Testing four instruction-tuned models from three families in five Indic languages alongside English suggests that safety evaluations in Indic languages may not reflect how models treat their everyday users.
Trizal Garg, S. Mitra, Aryan Karanjkar et al.· 0 citations
Orchestrating multiple agents on a complex task requires reconciling local subtask execution with global task planning. Dynamic dispatch approaches provide execution flexibility but do not explicitly model subtask hierarchies or dependencies, while predefined workflows impose this structure but fix the decomposition be...
Yan-Chen Deng, Jian-Guo Huang, Yao-Long Teng et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Language model agents increasingly automate post-training, but when given the full training stack they converge on supervised fine-tuning and spend most effort revising training data. Existing systems give the agent one kind of control, selecting rows from a fixed pool or calling a generator, whereas a human data engin...
Bing-Xiang He, Peng Sun, Shi-Hao Peng et al.· 0 citations
LLM systems increasingly rely on groups of agents that discuss, critique, and check one another, assuming that peers will catch individual errors. We test this assumption against a minimal adversary. In a ten-agent factual discussion, one or three adversarial agents repeatedly assert a plausible false answer. After eac...
Liangjie Huang, Henry Peng Zou, Wei-Chieh Huang et al.· 0 citations
RoleQ is introduced, a quantization framework that places scales by the functional roles of Transformer units rather than by the layout of the weight matrix, as conventional formats do, and leads every post-training ternary method at matched or lower memory-resident bits on perplexity, zero-shot accuracy and MMLU.
Johannes Knittel, Alec Helbling, Hanspeter Pfister· 0 citations
Large Language Model agents operate through closed-loop action policies whose decision space is defined by an agent harness. We investigate how this operating space shapes agent behavior and policy learning in computer-aided design (CAD), a professional domain characterized by persistent state, geometric constraints, a...
Yu-Feng Peng, Yi-Xin Zhang, Zi-Yi Liu et al.· 0 citations
A standard decidable regime used in practice is identified under which exhaustive simulation yields a terminating search procedure with the desired guarantees, and the limit of this recovery is shown: a chain of accepted updates can raise the bounded score in every round while the true score falls.
Brian B. Moser, Stanislav Frolov, T. Nauen et al.· 1 citation
Understanding how the human brain constructs meaning from real-world language remains a fundamental challenge, as semantics depend on context that varies in natural settings. To enable the study of real-world linguistic meaning in the brain, we introduce SCRIBE, a framework grounded in a neuroscience-informed semantic...
Camila Kolling, Omer Moussa, Emin Çelik et al.· 1 citation
Large language models (LLMs) predict neural responses during naturalistic language comprehension, but the linguistic information underlying this brain alignment remains difficult to interpret. We use SCRIBE, an interpretable contextual semantic representation spanning 65 neurocognitively grounded semantic properties, a...
Scientific agents must connect research problems, methods, and findings dispersed through narrative articles. We introduce SPRA (Structured Paper Representation for Agents), a paper-level representation of persistent research objects and typed relations. Its empirical-AI profile organizes Problems, Contributions, Compo...
Yu-Tong Leng, Hao-Jiong Chen, Fu-Kai Shang et al.· 0 citations
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.
A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.
Microsoft Research Blog· microsoft.comOct 15, 2026
Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.