This paper investigates developing real-world perception for active agents, proposes Gibson Environment for this purpose, and showcases a set of perceptual tasks learned therein.
F. Xia, Amir Zamir, Zhi-Yang He et al.· 2018 IEEE/CVF Conference on...· 1,069 citations· ⚡112
Video generation models can now depict remarkably realistic motion. Yet it is unclear how to use this motion beyond pixels: to animate a specific 3D asset and replay the animation in its 3D scene. For instance, a video model can show a monkey jumping over a crossbar, but it cannot return that jump as replayable 3D moti...
Noam Rotstein, Yoad Tewel, Chen Tessler et al.· 0 citations
Agentic artificial intelligence (AI) systems hold immense potential for automating complex workflows in materials discovery and design, but extending them to domain-intensive mechanistic investigations remains challenging. Here, we present GBClaw, an agentic AI framework for investigating the structure and deformation...
Yazhuo Liu, Kunqing Ding, Xiaoguo Gong et al.· 0 citations
Motivated by the human ability to integrate experience across language, perception, and action, we introduce UniWALM, a unified world-action-language model that learns video, action, and language in a single shared representation, where each modality is both a conditioning signal and a supervision target. We ask: can j...
Rahul Sajnani, D. Romeres, Ming-Yuan Zhang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
IndustrialRemembr, a shared spatiotemporal memory system that extends NVIDIA ReMEmbR to robot fleets and reduces server-side computation by generating scene descriptions only on demand, is presented.
Jad Yammine, Malek Wahidi, Abrar Anwar et al.· 0 citations
MindCue is proposed, a training-free spatial evidence selector guided by a target-view hypothesis that reverses the drop in overall score under expanded context and outperforms the standard-context baseline, and provides a concrete testbed for generative multi-view spatial intelligence.
Yan-Bo Wang, Si-Qi Luo, Si-Yu Zhang et al.· 0 citations
Mathematical reasoning remains underexplored for low-resource languages, including Dialectal Arabic. To bridge this gap, we introduce the DAR-MGSM (Dialectal Arabic Multilingual Grade School Math) Benchmark, the first manually curated benchmark for evaluating mathematical reasoning in Dialectal Arabic. DAR-MGSM consist...
Noor Abo Mokh, Teresa Lynn, N. Habash et al.· 0 citations
TS2Vec is one of the strongest self-supervised methods for time series classification, introduced in 2022. It is designed to be trained anew on every dataset: self-supervised pre-training followed by linear probing. Since then, the field has shifted towards foundation models that reuse one encoder across datasets. Yet...
Vasilii Feofanov, Zhenghan Tai, Andrei Ermakov et al.· 0 citations
Agentic on-policy distillation (OPD) trains a student agent on its own trajectories while a teacher scores every token. A natural explanation of where it goes wrong is compounding error: the student's mistakes carry its trajectories beyond the region where the teacher is reliable, so recent methods keep training inside...
Simulation is a powerful tool for robotics, but building diverse, simulation-ready scenes at scale remains difficult. Reconstructing scenes from single images is a promising alternative, but visual similarity alone is insufficient: objects must also be recovered, accurately placed, and physically grounded. Existing met...
Run-Dong Luo, Yu-Nong Liu, Dian-Long Cao et al.· 0 citations
Cellular states are shaped by both intrinsic gene expression programs and the spatial microenvironment in which cells reside. Spatial transcriptomics makes this context measurable, but effective representation learning requires capturing both spatially informative molecular signals and intercellular organization. Exist...
Azim Dehghani Amirabad, Ali Khodabandeh Yalabadi, Artem Moskalev et al.· 0 citations
Continuous flow language models offer a path to parallel generation with tools for control and acceleration unavailable to discrete diffusion, yet effective techniques for building them at the billion-parameter scale remain less established. We present Lafa (Large flow language model), a fast, high-performing flow lang...
Arnav Chavan, Chanhyuk Lee, Udbhav Bamba et al.· 1 citation