Reconstructing and animating water scenery from nature produces compelling and immersive visual experiences. Previous work examined this task from the perspective of 2D video textures, with the goal of creating a looping video. In our work, we tackle the problem from a 3D perspective, creating a looping 4D dynamic reco...
Chu-Han Chen, Yen-Chi Cheng, Ayush Saraf et al.· 0 citations
We present MimicAgent, a prompt-to-trajectory generation framework for learning dynamic quadruped skills. Although reward shaping is extensively used when training quadruped policies, navigating the resulting reward landscape is notoriously difficult, requiring hours of"graduate student descent". Eureka attempts to aut...
L. Nayak, Narayanan Parameswaran, Neehar Peri et al.· 0 citations
ModAR is introduced, the first WAM to autoregressively denoise multiple future modalities before predicting actions, and it is found that ModAR's sequential generation outperforms existing WAM formulations, with the highest average success rate at all evaluated data scales.
Adam Hung, B. Duisterhof, D. Ramanan et al.· 1 citation
It is shown that a flexible and expressive transformer, PointZero, outperforms prior methods on the same data and demonstrates the utility of the pre-training objective by post-training PointZero for two downstream applications: action-conditioned 3D dynamics prediction and imitation learning.
B. Duisterhof, Kai-Feng Zhang, Adam Hung et al.· 3 citations· ⚡1
This paper reconsiders intelligence from a vision-centered perspective and examines whether intelligence emerging from visual experience and learning may provide a pathway toward AGI. In the language domain, beginning with the introduction of the Transformer architecture, the GPT series has demonstrated transfer to uns...
Hirokatsu Kataoka, Yoshihiro Fukuhara, Yonglong Tian et al.· 0 citations
OV3D-Bench is introduced, a diagnostic benchmark that compares open-vocabulary monocular 3D detectors under deployment-realistic conditions across seven indoor and outdoor datasets, and indicates that geometric localization is more mature, while open-vocabulary semantics remains the primary bottleneck.
M. Gladkova, Neehar Peri, Ishan Khatri et al.· 0 citations
We introduce Point4D, a feed-forward model for 4D reconstruction of long-range video sequences. Point4D is able to reliably infer dense per-point 3D trajectories across multi-hundred-frame videos, unlike existing 4D methods that are limited to short input windows of at most a few dozen frames. A key innovation that ena...
Minsik Jeon, Jay Karhade, D. Ramanan et al.· 1 citation
This work presents FixAnything, a single model for fixing a wide range of rendering artifacts by repurposing a pretrained video generative model, leveraging its implicit multi-view priors with only minimal modification and lightweight finetuning.
Khiem Vuong, D. Ramanan, Srinivasa G. Narasimhan· 1 citation
LightCrafter, a hybrid pipeline that reformulates video relighting as video translation of a proxy video, bakes illumination targets into the PBR proxy, removing the need to teach the diffusion model illumination concepts like environment maps, and enables more intricate lighting control while naturally providing long-...
Zixi Guo, Yehonathan Litman, Yiting He et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
