Cross-model KV cache sharing reduces prefill computation by allowing a receiver model to reuse prefix KV states generated by a related sender model. Existing methods optimize such reuse for latency and generation quality, but its safety implications remain unclear. In this work, we systematically evaluate this issue ac...
Zhi-Wei Lin, Jia-Hao Liu, Yan Liu et al.· 1 citation
Linear attention and recurrent models compress past tokens into a fixed-size state that is updated at every step. However, storing these states in high precision incurs substantial memory and bandwidth costs at large batch sizes, motivating low-bit state quantization. Unlike weights and key--value caches, a recurrent s...
Hao-Tian Li, Li-Ran Dong, Kai-Cheng Xiao et al.· 0 citations
A central desideratum in model editing is generalization to complex tasks, which prior work formalizes under a direct generalization paradigm: treating and evaluating LLM behavior as an input-output mapping and expecting a factual update to alter outputs on reasoning tasks. Yet despite substantial empirical effort, the...
Xiaotian Ye, Chunyao Yang, Xiaohan Wang et al.· 0 citations
We present DRanker (Disney+ Ranker), a transformer-based multitask ranking model serving personalized recommendations on the Disney+ homepage. We describe the encoder-only architecture over enriched engagement-history sequences paired with a lightweight causal debiasing mechanism, and the inference stack that enables t...
Priya Nirmal Singh Khokher, Daniel Nemirovsky, Benjamin P. Whitesell et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Generative policies offer expressive action distributions for online reinforcement learning (RL), but many diffusion- and flow-based policies require costly iterative sampling. We propose DriftSpread, a one-step generative policy based on Drifting for online maximum-entropy (MaxEnt) RL. To incorporate entropy without a...
Chun-Yu Luo, Hong-Yu Zhao, Guang-Yi Ni et al.· 0 citations
Centrality measures rank nodes even when the observed differences can be explained by ordinary structural variation. We therefore study a preceding question: whether a network contains a statistically identifiable central structure at all. We formulate this question as a network-level hypothesis testing issue using the...
Qi-Long Wu, Yu-Xiao Li, Si-Meng Zhang et al.· 0 citations
Small language models (SLMs) used as on-device agents must balance accuracy and latency as their context grows. Mixed precision helps manage this tradeoff by assigning different precisions to weight tensors according to their size and sensitivity. However, these choices depend on the operating conditions, so a configur...
Knowledge graph (KG) foundation models (KGFMs) predict links on unseen graphs zero-shot. KGFMs have been pioneered by ULTRA which builds a relation graph from co-occurrences that match motif templates, and passes messages over it to obtain relation representations. More recent KGFMs such as MOTIF and TRIX increase the...
Cosimo Gregucci, Daniel Hernandez, Antonio Vergari et al.· 0 citations
Choosing a mixed-precision configuration for large language model (LLM) serving trades speed against accuracy. Allocators that use average bit-width or a memory budget as a speed proxy can miss changes in the resource that limits execution. We argue that served speed can be limited by compute, weight loading, or key-va...
Experiments on CIFAR-10 with time-varying RAN channels show that ARC-FedSC outperforms baselines across all five tested role configurations in the later training stage, and ablation and sensitivity studies further support the effectiveness and robustness of the proposed design.
Multi-label learning typically pursues model construction through the joint optimization of label fitting, correlation modeling, and structural regularization. While empirically effective, such a coupled paradigm imposes multiple learning objectives on a single predictive parameter matrix, forcing it to simultaneously...
In practical engineering and scientific computing, a real physical system can be reduced to a boundary value problem, and the adequate boundary information to determine the interior spatial distribution and evolutionary state of the physical field can be solved with linear equations, alternatively, the the real physica...
RongZe Gao, YuWei Wu, XinRan Ji et al.· 0 citations
A machine-learning approach called CheMeleon provides a practical way to develop new drugs or other molecules with much less detailed, expensive experimentation.
Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.
Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
