Interpretability, AI auditing and assessments of machine consciousness increasingly rest on mechanism-level quantities: functionals of a system's causal transition law that describe how it computes, not what it outputs. Experiments see that law only through finite, partial and noisy interventions. We ask when such a qu...
To interpret a direction in a language model's residual stream, we can look for text that strongly activates it. But when such text is found by scanning a corpus, it is limited to what that corpus contains. We develop Maximally-Activating Example Metamodels (MAEMs), language models which map residual stream directions...
Celeste De Schamphelaere, Juan J. Vazquez, Ari Spiesberger et al.· 0 citations
Typed-decision models score options that the caller supplies at request time, so their accuracy depends on label wording that the model's developer does not control. We compare two releases of a 307M-parameter multilingual cross-encoder, Ru-Jev, trained on thirteen Russian-language tasks; the later release adds an augm...
Neural networks are likely to be among the most consequential artefacts in human history. As these systems become more capable and autonomous, their potential to cause societal harm also grows, making AI safety one of the defining challenges of our time. Yet we continue to build increasingly powerful systems without fu...
Fazl Barez, Tung-Yu Wu, Hunar Batra et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
LLM-based medical assistants that follow a patient across visits need a memory that keeps the patient's clinical state correct as it changes. We examine the errors of five memory systems on longitudinal medical dialogue and find three recurring causes: the retrieved evidence gives an outdated state, includes another pe...
Donghua Zhang, Zizheng Wang, Ze Dong et al.· 0 citations
Vision-Language-Action models (VLAs) enable general-purpose embodied intelligence, but their performance is brittle under distribution shift, where unanticipated failures can damage equipment or endanger people. Deploying VLAs in real-world systems therefore requires a runtime monitor that is timely, calibrated, and in...
Michal P. Podolinsky, Yunhao Yang, Daniel Little et al.· 0 citations
Landing-phase safety-event prediction requires the detection of rare abnormal approaches within strongly imbalanced multivariate flight data. Capturing coupled temporal behavior while distinguishing event-specific signatures across airport operating contexts remains a central modeling challenge. This study proposes an...
Taha Asghar, Bilal Mufti, Syed Qasim Zaheer et al.· 0 citations
FedReason was the strongest server-side rule on CIFAR-100 but did not beat SCAFFOLD, which changes client training, and was the strongest server-side rule on CIFAR-100 but did not beat SCAFFOLD, which changes client training.
Ali Mohammadi Ruzbahani, Abbas Yazdinejad, Hadis Karimipour· 0 citations
Visuomotor policies trained through imitation learning are highly sensitive to changes in camera viewpoint. This is particularly problematic for mobile manipulation (MoMa), where robots rarely execute manipulation from the exact same base pose used during demonstration collection due to navigation uncertainty, localiza...
Sateesh Kumar, Arnav Balaji, Arpit Bahety et al.· 0 citations
Diffusion language models can write many tokens per step, but must choose which tokens are safe to commit together. Mean-field decoding penalizes pairs of positions whose predictions look alike. We replace this proxy with the coupling itself: how much committing one token changes the model's confidence at another. Chea...
LLM pruning must preserve quality while meeting hardware- and workload-specific constraints on latency, throughput, and memory. Existing pruning workflows often target parameter counts, requiring practitioners to manually select model sizes that meet latency, throughput, and GPU memory limits. However, parameter count...
Sheldon Liang, Ali Taghibakhshi, Saurav Muralidharan et al.· 0 citations