Model cards, system cards, and safety reports increasingly document LLM safety behaviors, yet safety evaluations typically start from predefined benchmarks rather than asking which documented claims those benchmarks actually test. We introduce LEST (LLM Evaluation through Specification-driven Testing), a framework that...
Asynchronous reinforcement-learning post-training of large language models is computationally efficient but inherently off-policy: the learner updates on rollouts generated by a stale policy, while correcting this mismatch requires importance weights that can be extremely heavy-tailed. A small number of trajectories ma...
Large multimodal models (LMMs) need to understand how entities move and interact as a scene develops. This requires following the same entities over time and relating their observed motion to subsequent changes. We formulate Scene Evolution Understanding (SEU), a task for predicting and interpreting this change. Given...
Chaoyue Li, Shoudong Han, Haoyang Wu et al.· 0 citations
Computational coarse-graining aims to replace a sequence of updates with a cheaper module while preserving task performance. We present a continuation-relative evaluation framework that assesses replacements through the computation that follows them, using downstream task quality and total execution cost as joint crite...
Shihua Yu, Yanzhi Wang, Tianchi Chen· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
It is widely appreciated that robotic policies require long-term memory to perform complex tasks. However, directly conditioning policies on all past observations leaves policy learning susceptible to learning spurious shortcuts, and introduces large latency at policy deployment. As such, today's memory-augmented polic...
Yilin Wu, Rutav Shah, Shuaiyi Huang et al.· 0 citations
Augmenting worker capabilities in the physical world through guidance has been a decades-long goal for AI agents. One key supporting capability is to understand what the worker is doing, seeing through the human's camera or smart glasses, and assist them in documentation. Despite advances in vision language models, the...
Andrew Perrault, Anmol Takiar, Dominik Winecki et al.· 0 citations
This article provides a gentle introduction to recent advances in deep learning from a control theory perspective and discusses how control theory has recently been used to better understand and design deep neural networks.
Álvaro Rodríguez Abella, J. Silvestre, B. Gharesifard et al.· IEEE Control Systems· 0 citations
Dexterous robot hands can receive useful motion intent from teleoperation or learned policies, but successful execution also depends on contact decisions that these commands rarely specify. We introduce DexFLEX, a contact-aware foundation controller that turns upstream fingertip-motion drafts into contact-consistent jo...
Weikang Wan, Zeyu Lai, Jianyu Hou et al.· 0 citations
Having demonstrated a strong potential for automating vulnerability discovery, AI agents can also be used to attack software systems at scale. Today's software systems need mechanisms to level the playing field by slowing down potential attacks, giving them time to patch vulnerabilities and strengthen software. Along t...
Jie Zhu, Ronik Bhaskar, Heather Zheng et al.· 0 citations
Accurate sampling from continuous-time generative models can require many model evaluations. Low-step sampling reduces cost, but coarse updates introduce endpoint errors that can accumulate and degrade generation quality. We introduce TraceSampler, a post-training method that corrects these errors without modifying the...
George Matthew (University of Exeter, United Kingdom), Guoqiang Zhang (University of Exeter et al.· 0 citations
Foundation models like V-JEPA are increasingly deployed across a heterogeneous edge-cloud continuum spanning smart glasses, phones, robots, and servers. Yet, they are typically trained as rigid, fixed-capacity networks bound to one device, supporting neither reconfigurable compute budgets nor collaborative execution. E...
Anxhelo Diko, Jieyu Lin, Stefano Ambrogio et al.· 0 citations
Reconstructing accurate camera poses and floor-plan layouts from sparse, unposed, wide-baseline RGB panoramas remains a challenging open problem. Direct multi-room floor-plan prediction is especially difficult in this setting: pose, geometry, semantics, and global layout structure are tightly coupled, yet a complete fl...
Yuguang Li, Yi-Chuan Deng, Zi-Xuan Liu et al.· 0 citations