As machine learning systems make increasingly greater decisions about people's lives, it is critical to provide users with actionable recourse about how they can achieve their desired outcomes. This problem is currently tackled by relying on expensive human supervision which involves hand-designing a cost function befo...
Classification accuracy and true-positive and false-positive rates alone do not determine whether restarting an AI agent improves success. Using an exact alarm-to-action identity for an independent clean restart with zero monitoring overhead, we show analytically that a monitor with fixed 90% accuracy can swing from a...
Siddharth Jain, Venkat N. Vedam· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
When one time series informs another, the delay at which that information arrives determines if models can utilize this relationship effectively. A source may be strongly predictive at one delay but uninformative at neighboring lags. Therefore, fixed input windows may obscure this structure by bundling informative and...
Emma Andrews, Konstantinos Kontras, Keane Ong et al.· 0 citations
As large language models advance rapidly, they are increasingly used to answer medical questions, and many such models are now deployed locally. Once a model is deployed, its behavior is governed mainly by the ethical policy written into its constitution. However, most existing work focuses on factual correctness rathe...
Yibo Yang, Zerui Huang, Haomiao Yang et al.· 0 citations
Cross-modal translation requires models to capture shared semantics across modalities while preserving the fine-grained structure required by the target modality. Yet in real-world scientific domains, paired data are often imperfect, while obtaining clean pairs at scale is costly. Supervised fine-tuning (SFT) directly...
Chaofei Hong, Ziyang Chen, Baochen Wang et al.· 0 citations
It is found that finishing an experiment and reproducing its signatures are different things, and across four multimodal models, each run ten times per task, it is found that finishing an experiment and reproducing its signatures are different things.
Kiante Fernandez, Caitlin Chen, Jia-Lu Zhou et al.· 0 citations
LLM agents interact with Web services to perform tasks on users' behalf. Errors during these interactions can disrupt execution and prevent task completion, motivating external intervention. However, agents may self-recover through continued execution, raising the question of when to intervene and when to wait for self...
Chiming Duan, Tong Jia, Yingxi Chen et al.· 0 citations
LLM agents that answer questions and act on behalf of users must decide when to yield to a user who disagrees. Disagreement may correct a genuine error or may be an attempt at manipulation. Prior work shows that models frequently abandon correct answers when challenged by users, yet it remains unclear whether they dist...
Nardine Basta, Venus Haghighi, Dali Kaafar et al.· 0 citations
The findings reveal that VLMs might be capable of rich, creative, and visually-grounded communication, but their interpretation and production of visual meaning diverges from human conventions in surprising ways, and highlights both the promise and challenges of visual communication between humans and VLMs.
Alexa R. Tartaglini, Zhengxuan Wu, Thaddäus Wiedemer et al.· 0 citations
Knowledge distillation from large reasoning models (LRMs) often uses raw teacher trajectories as supervision. However, this practice creates a mismatch between the goal of distillation and the nature of teacher trajectories. Advanced LRMs typically improve their reasoning capabilities through reward-driven post-trainin...
Ya-Shuo Luo, Qian-Ren Mao, Zi-Qi Qin et al.· 0 citations