Reinforcement learning with verifiable rewards spends much of its rollout budget on states that yield no learning signal. We recast this as a question about the sampling distribution itself: under a fixed rollout budget, which distribution over states minimizes the variance of the policy-gradient estimator? The answer...
The experiments show single-head beam search consistently beats MTP on most product-critical metrics: ranking and content QA, and trains at roughly 2.6x lower dollar cost on Qwen3-8B scale; MTP wins only on raw inference throughput.
Sejoon Oh, Fernando Amat Gil, Evan Smothers et al.· 0 citations
Reinforcement learning (RL) for large language model (LLM) agents remains challenging in long-horizon tasks with sparse outcome rewards, where assigning credit to individual actions is difficult. Methods such as GRPO assign the same trajectory-level advantage to all actions, while critic-based methods require learning...
Kai-Jie Zhu, Wei-Xiang Yan, Omar Attia et al.· 1 citation
Proposed HyperForecast is the first long-term time series forecasting (LTSF) framework operating in hyperbolic space and consistently outperforms existing and state-of-the-art baselines on 9 of 11 long-term forecasting benchmarks, achieving up to 58% lower mean squared error at long horizons.
Sarang Rajendra Patil, Vishal Fenn, Meng-Jia Xu· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Denoising Diffusion Probabilistic Models have emerged as powerful generative priors across domains ranging from molecular design to high-resolution image synthesis. However, standard diffusion sampling is inherently biased toward high-likelihood regions, often limiting the diversity of outputs. In many domains, a singl...
Hannah Janmohamed, João Correia, Penousal Machado et al.· 0 citations
Do genomic foundation models (FMs) provide predictive information beyond simple sequence composition? We evaluate frozen representations from five DNA FMs against normalized k-mer frequencies across 57 genomic classification datasets and two exploratory gene-expression regression tasks. Simple k-mer features remain com...
Vincenzo Yuto Civale, Andrew D. Bagdanov, Alberto Magi· 0 citations
Respiratory auscultation provides a low-cost means of assessing pulmonary function, yet transient crackles and sustained wheezes can be difficult to recognize in noisy clinical recordings. Conventional deep learning classifiers often operate as black boxes, offering limited insight into the temporal acoustic evidence s...
Yi Tian, Xiaohuan Chen, Yufei tang et al.· 0 citations
Generative modeling for tabular data has advanced to the point where models can synthesize realistic records, recover missing values, and generate samples conditioned on class labels or observed attributes. Despite recent advances, existing approaches either require table-specific training or restrict in-context learni...
Jayoung Kim, Sanghyun Hong, Noseong Park· 0 citations
ELECT, which instead settles cross-frame identity before final rendering through a language-guided scene-entity mapping and stationary anchors elected from the model's own drafts, shows that long-horizon consistency need not require increasingly expensive inter-frame conditioning as stories grow.
Mehrajul Abadin Miraj, M. Hasan, M. Farzana et al.· 0 citations
Probabilistic ocean modeling is essential for risk-aware marine operations, climate analysis, and scientific decision-making, where downstream decisions depend on the conditional distribution of future ocean states rather than a single deterministic trajectory. Recent data-driven ocean models have made deterministic gl...
SARATHI achieves competitive perplexity and matches or exceeds existing structured pruning baselines on zero-shot accuracy, and corrects systematic activation drift in post-LayerNorm architectures that would otherwise cause perplexity collapse at high sparsity.
Sankar Behera, Dhruv Singh, Satyadev Ahlawat et al.· Proceedings of the 2026 Conf...· 0 citations
KV caches make long-context serving efficient by reusing past computation, but model switching breaks this reuse and forces the receiver to prefill the context again. We study \emph{zero-prefill cross-model context handoff}: translating a sender cache into a receiver-compatible state so that the receiver can continue d...
Hao-Miao Qiu, Yi-Ning Tang, Zi-Jia Song et al.· 0 citations
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.