The proposed Synchrony-Guided Representation Alignment (SyncRA), a lightweight method for strengthening temporal correspondence between audio and vision, consistently outperforms answer-only fine-tuning across all model-benchmark combinations, while substantially improving the ability to track changing audio-visual pai...
Achieving high-quality, cinematic results in text-to-video generation remains challenging for non-experts, whose prompts often lack professional narrative and creative design. We propose SkillPE, a prompt engineering (PE) framework that evolves reusable cinematic skills from expert-authored seeds. SkillPE represents sh...
Yan-Wei Huang, Min Zhu, Shu-Jie Li et al.· 0 citations
Video-language models are increasingly used as judges of video understanding, both for evaluating model outputs and for training reward models. Whether their judgments remain reliable when the evidence is buried in day-long videos has yet to be established. Existing benchmarks cannot answer this. Their videos are typic...
ASECT improves over its backbone on three external pathology benchmarks covering classification and question answering beyond cellular composition tasks, and improves over its backbone on three external pathology benchmarks covering classification and question answering beyond cellular composition tasks.
Cheng-Yang Zhang, Wen-Chuan Zhang, Bo Li et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
REGDIFF is proposed, a generative framework that couples voxel representation with latent space regulation and guided diffusion that outperforms voxel-based generative baselines in geometric plausibility, novelty, and diversity and is suggested to be a strong geometry candidate generator for downstream evaluation.
Wang-Zhi Zhan, Jian-Peng Chen, Dong-Qi Fu et al.· 0 citations
World models infer latent states of an environment to capture its underlying dynamics and predict future evolution. Many real-world environments, however, are inherently relational and observed as evolving graphs, where entities, relations, and their properties change over time. Prior graph-related world models use gra...
PrefLUT is introduced, a reusable and refinable user-preference modeling framework for deployable 3D LUTs, encoding ordered preferred/non-preferred image pairs into a lightweight Reusable User Profile that is reused across queries and refined using additional user preference pairs, without per-user optimization.
Chuanzhi Xu, Lang-Yi Chen, Cheng-Kun Yue et al.· 0 citations
Spectrum-Balanced Feature Matching, SpecMatch, a simple objective that adaptively emphasizes under-optimized spectral directions while preserving the relative importance of dominant directions is proposed, which improves downstream adaptation across diverse tasks, including image classification, anomaly detection, medi...
Autonomous driving requires \textit{world models} that can understand the physical world, reason and plan, and operate safely. In this paper, we first systematically evaluate existing action-conditioned joint-embedding predictive architecture (JEPA) world models, including LeWM, DINO-WM, and JEPA-WM for end-to-end auto...
Hao-Ran Zhu, Wan-Cong Zhang, Yann LeCun et al.· 0 citations
This work proposes semi-supervised domain adaptation regression through whitening transform and dual consistency (WhiteCon), which combines domain-specific whitening transform (DWT) and dual consistency regularization to enhance training stability and domain adaptation.
S. Sim, S. Kim· International Conference on...· 0 citations
Multimodal models increasingly interpret visual environments, but their ability to recognize the same building across photographs, floor plans, elevations, sections, and renderings remains poorly characterized. We introduce ARCH-B, a benchmark of 354 four-choice questions across 11 cross-representational archetypes, co...
Kieran Sagar Parikh, J. L. G. del Castillo Y López· 0 citations
Adapting video models to new tasks typically requires dedicated data curation and fine-tuning. While visual analogy provides a training-free alternative by specifying tasks in-context, it remains restricted to the image domain. To explore whether analogy-based methods can unify diverse video tasks and generalize to out...
Chia-Hsiang Kao, Belinda Zeng, Bharath Hariharan et al.· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.