We study constrained contextual bandits with adversarial contexts, where each action yields a random reward and incurs a random cost. The conditional mean reward and cost belong to known function classes and are learned through online regression oracles. The benchmark is a stationary randomized policy whose expected co...
Auto-regressive token generation in large language models is memory-bound because it requires "attending to" key and value tensors (KV cache) of all previous tokens. Prior work aims to improve the efficiency of this decode process by batching multiple requests together, and maximizing batch size subject to GPU memory c...
Fitted Q-iteration (FQI) is well understood when the data come from a fixed distribution and the action set is finite, whereas value-based continuous control collects its data adaptively and maximizes over continuous actions. Both features break the standard analysis: the regression data are dependent, and every densit...
Manuel Hau{\ss}mann, Mustafa Mert \c{C}elikok, Melih Kandemir· 0 citations
Koopman-based neural MPC models generate time-varying dynamics from historical data, but preserve convexity by enforcing that the system operator is independent of the current control input. This conditional independence constraint limits adaptation to changing dynamics within a single MPC horizon, particularly under t...
Matan Pagi, Zohar Sorek· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Negative samples play a crucial role in graph contrastive learning (GCL), yet existing methods mainly focus on which negatives should be selected, mined, filtered, or progressively introduced. Less attention has been given to separating the negative candidates available to an anchor from the subset that actively partic...
Adnan Ali, Jinlong Li, Syed Muhammad Israr et al.· 0 citations
CircuITS, a novel architecture for probabilistic IMTS forecasting based on sum-product networks (SPNs), is proposed, which is flexible in capturing intricate dependencies between time series channels while structurally guaranteeing valid joint distributions.
Christian Klötergens, Vijaya Krishna Yalavarthi, Lars Schmidt-Thieme· arXiv.org· 1 citation
A simple hedging principle shows how splitting initial wealth between two strategies achieves a best-of-both-worlds guarantee by retaining the smaller of their regrets and the larger of their growth rates.
The paper proposes new algorithms for computing the regularization path of linear-model fitting (i) with L1 costs for the independent variables and L2 costs for the dependent variables, and (ii) with L2 costs for the independent variables and L1 costs for the dependent variables. Unlike previously proposed algorithms,...
Stability assessment is central to safety-critical systems governed by differential-algebraic equations (DAEs), whose dynamics are constrained by physical laws and admissibility conditions. These systems operate under stochastically varying environmental inputs, so stability must be reassessed as the context distributi...
Minxing Zheng, Zewei Deng, Liyan Xie et al.· 0 citations
The transition to electric mobility hinges on maximising aggregate adoption while also facilitating equitable access. This study examines whether the 'charging divide' between households with and without off-street parking reflects a genuine infrastructure constraint or a by-product of socio-economic disparity. Moving...
Bernardino D'Amico, Achille Fonzone, Emma Hart· 0 citations
World models are a promising path to zero-shot embodied control through planning. However, existing world model planners struggle on long-horizon, multi-stage tasks: prediction errors compound and naive search is exponential in the planning horizon. Hierarchy mitigates both by decomposing tasks into shorter, tractable...
Wancong Zhang, Basile Terver, Artem Zholus et al.· 0 citations
Reinforcement learning (RL) and model predictive control (MPC) offer complementary strengths, yet existing MPC-RL frameworks commonly rely on gradient-based optimization and therefore cannot handle the non-differentiable dynamics and objectives common in RL. We propose Soft MPCritic, an MPC-RL framework that learns a s...
Thomas Banker, Nathan P. Lawrence, Ali Mesbah· 0 citations
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.