Overall, it is shown that a single agent can learn to allocate resources across turns and adapt its behaviour to user-specified budgets using budget feedback without external budget-allocation controllers.
Tom A. Lamb, Adam Golinski, Eleonora Gualdoni et al.· 0 citations
A growing body of work proposes dynamic expert-skipping methods for Mixture-of-Experts (MoE) models that adjust the number of experts activated per token during inference, aiming to preserve model quality while further reducing the number of active parameters. These methods have added calibrated importance scores, inte...
Jakob Steimle, T. Elsken, Daniel Ehrhardt et al.· 0 citations
Object counting in videos remains a poorly characterized capability of multimodal large language models. Counting questions are included in many existing VideoQA benchmarks, but the ground-truth count distributions in these benchmarks are heavily skewed toward small values. Across the nine benchmarks we survey, the med...
Marc Chapus, Carlos Crispim-Junior, V\'eronique Eglin et al.· 0 citations
We study a linear mixing model with dependent latent components, assuming multiple data domains. Most existing models assume that the components are independent or at least uncorrelated, in line with independent component analysis (ICA). Some recent work allows for dependent components, but then makes specific assumpti...
Danru Xu, Lauri Parkkonen, Sara Magliacane et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Instruction-based image editing models can now add, remove a specified number of objects or change their category while preserving the scene. Yet these models often fail to produce the correct number, and these failures grow sharply as scenes become more complex and the requested count increases. Current benchmarks lar...
This work formalizes collaborative problem solving as block optimization as block optimization: each agent improves one part of a shared solution, guided by its local objective plus a correction for how its changes affect the other parts.
Direct Preference Optimization (DPO) minimizes empirical risk over observed preference comparisons, implicitly assuming that the training preference distribution matches the deployment preference distribution. In practice, this i.i.d. assumption often fails, as preference distribution shift exhibits a natural hierarchi...
This work introduces JAXbounce, a continuous control pong-like benchmark designed to evaluate active inference beyond discrete, low dimensional environments, and releases JAXbounce as a reproducible benchmark for continuous control active inference research.
Chaitanya Kaul, Markus Klar, Sebastian Stein et al.· 0 citations
Accurate electrical load forecasting supports power-system operation across countries, regions, cities, and buildings, but repeated development of target-specific models is costly. Time series foundation models (TSFMs) provide reusable pretrained backbones, although multi-domain pretraining may not fully capture load-s...
Aliullah, Julian Oelhaf, Edouard Fouch\'e et al.· 0 citations
Object-centric reinforcement learning agents typically receive each object's position in a fixed global frame, even though their decisions usually depend on where objects are relative to one another. These absolute views often fail to capture the local context that is most relevant to the agent's behavior. As a result,...
Cedric Derstroff, Jannis Bl\"uml, Janosch Moos et al.· 0 citations
On-policy distillation (OPD) supervises student-generated responses using sampled-token student-teacher log-ratios. A positive log-ratio penalizes a token that the student assigns higher probability to than the teacher, but its current value does not distinguish sustained high penalties from abrupt increases along a re...
Guang-Yu Liu, Si-Yuan Gan, Shi-Long Zhou et al.· 0 citations
Token merging is an effective approach to reducing KV-cache memory consumption in autoregressive video generation by clustering temporally redundant tokens and retaining only a small set of representatives. Existing methods, however, typically apply a uniform merging ratio across all attention layers and heads. We obse...
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.