Generative world models aim to predict future states conditioned on actions, where action controllability is fundamental for reliable dynamics modeling. While recent efforts leverage simulator-generated data to enhance this capability, existing training pipelines face two fundamental limitations. First, static offline...
Yi-Kun Miao, Fang-Qi Zhu, Quan-Xin Shou et al.· 2 citations
Despite impressive visual quality, state-of-the-art video diffusion models often generate content that violates real-world physical laws. While existing solutions rely on external priors or specialized data, we investigate the root cause by exploring the internal mechanisms of these models. Specifically, we present the...
Yue-Yan Li, Hai-Bo Wang, Cai-Xia Yuan et al.· 2 citations
This work introduces BoundStyle, a potent semantic attack operating in StyleGAN's rich latent space to maximize misclassification rates and develops StyleAT, an efficient adversarial training scheme that incorporates low-budget attack variants yet defends against stronger and unseen semantic attacks.
Ben Shapira, R. Cohen, Shang-Tse Chen et al.· 0 citations
Open-vocabulary audio-visual event localization (OV-AVEL) grounds a text-queried event in time from video, audio, and language, with a reliability-aware asymmetric distillation framework.
Yi Xu, Cheng Chen, W. Lei· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Automated pollen analysis supports veterinary cytology, but brightfield microscopy is costlier and more complex than lens-less digital in-line holographic microscopy. We evaluate whether reconstructed holograms can narrow this gap and whether model explanations remain reliable under modality change. Six pollen species...
Swarn Warshaneyan, Joial Danyal, Bla\v{z} Cugmas et al.· 0 citations
While compressed-sensing regularizers enable interpretable reconstruction of 4D Flow CMR through transparent variational objectives, their hand-crafted nature is too restrictive under high acceleration. State-of-the-art learning-based approaches mitigate this, but typically encode regularization implicitly through unro...
German Shâma Wache, Sebastian Neumayer· 0 citations
Talking-head and dyadic models now achieve real-time inference, yet fast motion generation alone does not produce an interactive conversation. A live system must synchronize the model's output with speech from an external voice agent, schedule video frames for playback, and handle interruptions. We introduce AVTR-1, an...
A. Kravtsov, Dmitrii Ziganshin, V. Poletaev et al.· 1 citation
Large vision-language models (VLMs) enable recognition beyond a fixed class set, but their computational demands prevent them from running on many edge devices. Cloud offload makes this capability accessible, but sending every image consumes scarce bandwidth and communication energy. We ask how to bring the open-world...
Mohammad Mehdi Rastikerdar, Hui Guan, Deepak Ganesan· 0 citations
A new face detection and recognition dataset, the Visage Face dataset, comprising 16,234 face samples, is proposed, showing that the Visage Face Dataset is a realistic and challenging benchmark for face recognition in classroom attendance.
Himani Trivedi, Hiren B. Patel, Ridham Patel et al.· 0 citations
Intrathecal contrast-enhanced MRI tracks how a cerebrospinal-fluid tracer spreads through the brain, but requires repeated scans over 24--48\,h. Forecasting enhancement from a pre-contrast scan could one day help select patients for intrathecal drug treatment and plan their dose. We ask how much of the enhancement at a...
Qinghui Liu, Jon Andr\'e Ottesen, Thu Nguyen et al.· 0 citations
An ultra-lightweight spatial-relational architecture for few-shot image classification that combines fixed Gabor edge-energy guidance with a windowed, content-adaptive patch locator is presented, showing that the architecture's pairwise relational computation, while present, is not the primary driver of its performance...
Instruction hierarchy (IH) alignment teaches language models to prioritize higher-level instructions when inputs conflict. While studied primarily in text-only settings, vision-language models (VLMs) introduce new challenges for IH: instructions may be embedded in images, split across modalities, visually transformed,...
Nicholas Sansoterra, Zi-Shuo Zheng, Sachin Kumar· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.