FineART is presented, a densely annotated bimanual manipulation dataset comprising 40,543 episodes and 533,913 subtasks across 151 tasks and FineART-VLA is introduced, a vision-language-action policy that predicts its own next subtask to guide its actions.
Jade Choghari, Pepijn Kooijmans, Mansi Agarwal et al.· 0 citations
AdaKerNet is introduced, a novel learnable task-adaptive neural kernel decoder that operates solely on its (frozen) rich representations obtained from the diverse available modalities and established as an effective approach for prediction from frozen multimodal representations in the scarce label regime.
Konstantinos D. Polyzos, Eleni Oikonomou, Tara Javidi· 0 citations
Prediction-Aligned Context Compaction (PACC), which uses a learned compressor to aggregate information across past frames into compact memory tokens, shows that learning to compact historical context can improve long-video memory without modifying the underlying generator.
Xiao-Yu Wu, Wei-Hang Guo, Yi-Fei Wang et al.· 0 citations
The results show that representation need not remain a by-product of generation or merely a tool for improving it: it can be directly optimized as a first-class capability of diffusion pretraining alongside generation.
Xiao-Yu Wu, Yi-Fei Wang, Chen Wei· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Wildfires are an increasing hazard to ecosystems, air quality, and human systems, creating a growing need for datasets that support systematic development and evaluation of models for predicting fire spread across diverse landscapes. Effective prediction requires integrating meteorological conditions, fuels, vegetation...
Arya Kondur, Giosue Migliorini, Cameron Schmitt et al.· 0 citations
SAGE-Restore (Stroke-Aware Gated rEstoration), a selective restoration framework that first assesses where restoration is needed and then uses this assessment to guide restoration candidate generation and pixel-level selection, is proposed.
Ming-Qiu Liang, Dongdong Wang, Si-Yang Lu et al.· 0 citations
MATE (Mutually Adversarial self-Training with Evolving data), a reinforcement-learning-based post-training framework in which the two branches instead challenge each other, and the challenges evolve as the model trains, turns the training into self-play in data space.
Diffusion models can produce striking images and videos, but they still struggle with the compositional details that make a generation faithful to a prompt, such as object counts, attribute binding, spatial relations, and temporally grounded actions. A common way to improve prompt satisfaction is to spend more compute...
Vighnesh Subramaniam, B. Katz, Brian Cheung et al.· 0 citations
By clarifying when and why gap modification changes model behavior, this account provides a principled basis for selecting gap interventions in similarity-based vision-language systems across evaluated downstream tasks.
A large-scale benchmark suite for open-world aerial object-goal search, with 3 times as many scenes and 18.7 times as many task instances as the largest existing benchmark for this task, and a unified evaluation framework with a unified evaluation framework.
Tong-Tong Feng, Xin Wang, Hao-Ran Hou et al.· 0 citations
Vision-and-Language Navigation (VLN) has largely focused on a single agent following a single instruction, yet many real-world applications require teams of robots to tackle tasks beyond the capabilities of any individual agent. We present Systematic Multi-Agent Vision-and-Language Navigation, providing, to our knowled...
PACT is proposed, which turns this structure into four training terms that need no new annotation: a difference-in-differences margin over each pair that is invariant to any shared logit offset, a permutation-consistency term against answer-code position bias, an evidence-necessity term on certificate-verified ablated...
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.