Head-dimension compression can reduce the memory required by the key-value (KV) cache, but existing methods often reconstruct full-dimensional representations during inference, adding significant decoding FLOPs overhead. We formalize the design considerations for converting pretrained attention into a natively reduced-...
Irene Tenison, Abdulrahman Alabdulkareem, D. Weidele et al.· 0 citations
Maps are central to how humans make sense of the world, from navigation and environmental monitoring to military planning and historical interpretation. Yet despite rapid progress in large multimodal models (LMMs), these systems continue to struggle with interpreting maps – an essential skill for visual reasoning that...
Christian M. Arnold, Andrew Alini, Abdulrahman Alabdulkareem et al.· Proceedings of the 28th Inte...· 1 citation
To evaluate the frontier, we must measure models not by what they say, but by what they can engineer and build in grounded physical environments. We introduce \textsc{ArtifactArena}, an open-ended platform where models face a physically grounded hardware-software co-design challenge: engineering fully functional robots...
Kushagra Tiwary, David Mayo, Nikhil Behari et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
