Triangular Resampling is introduced, a post-training method for mitigating long-horizon error accumulation in motion diffusion models that addresses the mismatch between ground-truth-derived training windows and model-generated inference states.
Kun-Hang Li, Yi-Yi Cai, Xiang-Yue Zhang et al.· 0 citations
The proposed Future-Aware Recall (FAR), a framework that learns episodic recall from future-aware predictive supervision and adaptive multi-cue scoring, is established as a flexible, principled approach to episodic memory access in world models.
Beomsu Kim, Chieh-Hsin Lai, Bac Nguyen et al.· 0 citations
Evidence-Aligned multimodal on-policy self-Distillation (EAD), which retains the crop-conditioned teacher as the target but constructs a separate evidence reference for weighting the corrections, consistently outperforms previous state-of-the-art methods.
Nan-Xing Hu, Qi-Wei Yan, Jin-Chao Zhang et al.· 0 citations
This paper proposes a ``summarize before grounding''framework (named ``SumGround'') for long-video temporal grounding, and introduces query-guided latent summaries, which is represented as KV states of query-guided prompts, to compress redundant visual tokens into compact query-relevant chunk summaries.
Nan-Xing Hu, Xiao-Yue Duan, Qi-Wei Yan et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
IR4RL is introduced, an RL framework with a token-level render-progress reward that turns changes between intermediate renders into localized feedback for the generated sequence, showing that intermediate rendering provides a simple and effective source of process supervision for RL post-training of image-to-code model...
Omri Kaduri, Kate Feingold, Phillip Isola et al.· 0 citations
Single-image novel view synthesis remains challenging because the underlying 3D geometry is highly ambiguous. Recent diffusion-based approaches produce plausible results, but they often struggle to preserve the geometric structure and spatial coherence of foreground objects. We present GenNVS, a framework for geometry-...
Ya-Jiao Xiong, You-Yu Luan, Xiao-Yu Zhou et al.· 0 citations
This work introduces ActionLens, a diagnostic benchmark of 6,701 multiple-choice video questions spanning five targeted diagnostics: transition detection, actor-specific identification, concurrent action binding, directed interaction reasoning, and gaze detection, and diagnostic measurements of these distinct failure m...
Gueter Josmy Faure, Min-Hung Chen, Hao-Ping Wang et al.· 0 citations
SentZero, an enhanced sentence-centric VL pretraining framework for zero-shot, multi-task CXR analysis, introduces LLM-based abstract-level sentence structuring and mapping to expand positive-pair diversity, together with an additional loss term to mitigate false negatives.
Hangyul Yoon, Hyungyung Lee, Edward Choi et al.· 0 citations
VLAcneSeg is proposed, a multimodal framework for acne lesion segmentation that leverages CLIP and region-level text prompts to incorporate spatial priors, enabling lesions to be localized across the whole face.
Sukju Oh, Soo Ick Cho, D. Suh et al.· IEEE journal of biomedical a...· 0 citations
We present EditWorld, a video world model for precise editing and flexible referencing in interactable worlds. Existing video world models primarily focus on navigation, letting users explore generated worlds but offering limited control over how existing world content is modified. EditWorld extends world modeling from...
Xin-Yao Liao, Xian-Fang Zeng, Zhu Liang et al.· 0 citations
Due to the gigapixel-scale nature of whole-slide images (WSIs), weakly supervised WSI analysis is commonly formulated as a multiple instance learning (MIL) problem, where patch-level features are aggregated into slide-level representations. However, diagnostic and prognostic evidence often arises from spatially coheren...
Lei Wu, Jia-Shuai Liu, Di Zhang et al.· 0 citations
MILD, a Motion-Preserving Image-to-Video Latent Distillation framework that transfers specialized image expertise while preserving pretrained video dynamics, is proposed and established as an effective route to improving video generation by drawing on the diverse and evolving capabilities of the image-generation ecosys...
Bing Jiang, Li Luo, Zi-Chao Yu et al.· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.