KeyRec is a training-free framework for constructing bounded visual memory that preserves fine-grained recent observations in a visual cache and organizes historical evidence into a structured event bank and achieves the best compressed performance in 13 of 15 settings using only 10\% of the dense decoder-facing visual...
Zi-Han Chen, Xuejian Rong, Xiao-Juan Wang et al.· 0 citations
Autoregressive video diffusion is a promising render-time fixer for 3D Gaussian Splatting (3DGS) in autonomous-driving simulation, but deployment demands high visual quality and temporal consistency at low latency. This is especially hard for one-step causal generation, where each imperfect prediction immediately becom...
Boseong Jeon, Junhyeop Lee, Juhan Cha et al.· 0 citations
ReFM is proposed, a source-mesh-agnostic, energy-guided model that reformulates motion retargeting as progressive refinement and progressively refines an initialized target motion through a learned flow guided by semantic consistency, physical plausibility, temporal coherence, and minimal motion modification.
This survey formalizes persistent evidence-grounded document state as a unifying framework, specifying the operations and invariants required to convert multimodal evidence into durable, provenance-linked state.
Souhail Bakkali, Ayoub Merimi· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
When several surfaces are visible along a ray, recovering visible 3D structure from one image requires jointly estimating their presence and metric depth. Depth Any Seen represents these surfaces as image-conditioned multi-Bernoulli depth sets, whose components each contribute one depth or remain absent. Its auxiliary-...
TriO is a multi-modal unsupervised world model that predicts 4D occupancy, obstacle segmentation, flow and LiDAR, and is able to segment any occupancy from the drivable surface, overcoming the limitations of existing open-set methods in handling long-tail objects.
Quinlan Sykora, Sourav Biswas, Christopher Diehl et al.· 0 citations
CaptchaArena, the first large-scale, fine-grained training dataset for interactive CAPTCHA solving, is presented and CaptchaAgent, a single 9B policy for all 20 CAPTCHA types, is trained with supervised fine-tuning followed by reinforcement learning.
Zhen-Hao Zhang, Zhao-Yu Fan, Hao-Han Ying et al.· 0 citations
Robots on construction sites must detect workers who are kneeling or bending, which we call low poses. These workers can be lost from training datasets during automatic labeling. We study a pipeline that detects people, estimates their body joints using NLF, and groups similar poses. Low poses account for only about 2...
A training-free method that reformulates question--frame matching as comparing frames against a set of dynamically generated visual cues, showing that agentic cue refinement drives active re-exploration of the video, yielding relative similarity gains of up to 92% over the initial context.
W. Kang, Hanieh Deilamsalehy, Yumo Xu et al.· 0 citations
Developing label-efficient models is a central challenge in surgical AI due to the high cost and scarcity of expert annotation. While self-supervised foundation models adapt well to new tasks with minimal data, how label efficiency varies across different surgical tasks remains largely unexplored. Here, we introduce SU...
F. Stilz, L. Arboit, V. Srivastav et al.· 0 citations
Video-to-music models have advanced considerably in the last few years, particularly in film and music video applications. In this paper, we investigate this problem in the video game domain, which introduces new challenges for these models: video frames are rendered graphics, music is mostly synthetic audio, and sound...
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.