In this article we prove that estimator stability, together with a gradient-growth condition on the expected fitted loss, is enough to provide concentration bounds for leave-one-out cross-validation in a general framework. In particular, we provide concentration bounds beyond Lipschitz continuity assumptions on the los...
This work forms compact tensor-reduced representation of the local atomic environment whose size does not depend on the number of chemical elements, is systematically convergable, and therefore remains applicable to a wide range of data analysis and regression tasks.
J. Darby, D. Kov'acs, Ilyes Batatia et al.· Physical Review Letters· 43 citations· ⚡1
We show how a pair of points can uniquely represent a left-infinite sequence obtained from observations of an underlying dynamical system through a phenomenon called \textit{causal embedding}. A driven dynamical system creates such pairs, and a function can be learnt on them that can reconstruct the underlying dynamics...
G Manjunath, A de Clercq, MJ Steynberg· 0 citations
In stochastic multi-armed bandits, rewards are generated by an unknown distribution; the world's reward uncertainty induces the exploration-exploitation trade-off. Thompson sampling (TS) addresses this trade-off elegantly, but requires knowing the reward model's parametric form to sample from its posterior and compute...
I\~nigo Urteaga, Chris H. Wiggins· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
The automatic segmentation of human knee cartilage from 3D MR images is a useful yet challenging task due to the thin sheet structure of the cartilage with diffuse boundaries and inhomogeneous intensities. In this paper, we present an iterative multi-class learning method to segment the femoral, tibial and patellar car...
We forecast clot growth from sparse early measurements with incomplete biochemical information. Using 1,000 simulated trajectories, we compare inverse search, which weights candidate inputs by their agreement with early observations, with a direct multilayer perceptron (MLP) predicting future clot size. Inverse search...
Lennon J. Shikhman, Lily DiPaulo, Ying Qian et al.· 0 citations
Language models for low-resource languages still make frequent grammatical errors. Alignment methods such as RLHF and DPO can correct them. However, they require human judgements, which are scarce for languages such as Icelandic. Automatic rewards offer an alternative, yet models can learn to exploit them without impro...
Hoda Fakharzadehjahromy, Emil Wiman, Andreas Bueff et al.· 0 citations
Existing low rank KV cache methods preserve either model weights or key variance, neither of which directly reflects the attention scores used during inference. We derive the expected attention score distortion caused by rank r key compression and show that it yields a covariance weighted low rank objective. Under a ma...
Sparse-reward reinforcement learning often fails because rollouts from the unassisted evaluation start rarely reach later task stages. Reverse curricula address this by starting some training rollouts from easier intermediate states, called scaffolds. The main choices are which intermediate starts to use (scaffold acce...
Understanding animal behavior at an algorithmic level -- what animals attend to, how they form internal representations, and how this maps to action -- remains a central challenge in neuroethology. We explore how well large generative models capture properties of fly social behavior. We combine transformers with agent-...
A pedagogical bridge is developed between linear classifiers and single-qubit mixed-state classifiers by characterizing their geometric model structure, which reveals that a single-qubit mixed-state model for binary classification can be viewed as the ``ellipsoidal version'' of a standard linear classifier.
Hidden-state trajectories are computational traces that record how recurrent representations evolve as networks process sequences. When exact state repeats are unavailable, one way to estimate conditional motion is to borrow successors from nearby states, yielding a finite-bandwidth successor smoother. However, this pr...
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.