Reasoning across videos requires aligning events, matching identities, comparing motion, and integrating partial observations. Evaluating these capabilities and testing how to improve them requires both reliable labels and targeted supervision. We introduce SYNCR, a simulator-grounded framework that connects these two...
Sara Ghazanfari, Siddharth Garg, P. Krishnamurthy et al.· 0 citations
Multimodal continual instruction tuning (MCIT) aims to enable multimodal large language models to acquire new capabilities from sequential tasks while preserving previously learned knowledge. Existing methods primarily mitigate catastrophic forgetting by constraining parameter updates or separating task-specific adapta...
Tao Hu, Zhi-Nuo Zhou, Xia-Liang Tong et al.· 0 citations
Class-Incremental Learning (CIL) requires models to recognize new classes over time without forgetting previously learned ones. With the rise of vision-language pre-training, CLIP has become a strong foundation for CIL. A common design in CLIP-based CIL is to construct textual classifier weights by encoding class-name...
Tao Hu, Zheng-He Xie, Jing-Cai Guo et al.· 0 citations
Few-step flow-map generators, including MeanFlow and consistency models, enable efficient sampling through long-range transport, yet their on-policy distillation remains underexplored. We introduce FlowMap-OPD, an on-policy distillation framework that separates student-state acquisition from teacher--student distributi...
Zhiqi Li, Bo Zhu· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Biomedical machine learning papers often compress model performance into one headline number. That number can look like a property of the model even when it depends strongly on how the benchmark was evaluated. We study this problem on the widely used Kermany pediatric chest radiograph dataset using nine image classifie...
Bhanu Prakash Vangala, S. Guda, Latha Peddi et al.· 0 citations
Satellite observations, precomputed embeddings, and map products describe the same evolving Earth, yet are stored as independent, petabyte-scale data products. Their continued growth calls for compact representations of multiple products while preserving spatial and temporal detail. We introduce Planetary Feature Field...
Arjun Rao, Sebastian Loeschcke, A. Fuller et al.· 0 citations
Instruction-based image editors insert objects, restyle scenes and render new viewpoints, but it is unknown which camera they assume when they paint into a photograph. Asked to cover the floor with a checkerboard, an editor paints projective structure from which classical vanishing-point geometry reads pitch, roll, foc...
There has been significant work on understanding the In-Context Learning capabilities of Large Language Models, especially on the induction circuit. For a few-shot classification task, the induction circuit leverages linear representations of each labeled example in-context in order to classify an unlabeled query. Howe...
A. de Senneville, Xavier Bou, J. Anger et al.· 0 citations
TomoTransformer is introduced, a transformer-based architecture that treats each filtered back-projection images or sinograms as an individual token and predicts missing views via self-attention and is fully agnostic to the number of input and target projections.
This paper designs an algorithm that combines denoisers at decreasing noise levels with a schedule tailored to ensure convergence, and proves that it surpasses convergent methods while competing with state-of-the-art empirical ones.
Alexandre Lagier, Valentine Tosel, Anne Gagneux et al.· 0 citations
Precipitation nowcasting, generating future radar fields from past observations, is critical for flood warning and disaster response. It is also a demanding benchmark for spatiotemporal generative modeling, with chaotic dynamics, heavy-tailed intensities, and rare high-intensity structures that matter most. Determinist...
Shunya Nagashima, Takumi Bannai, Makoto Misaizu et al.· 0 citations
Bi-temporal change understanding, which localizes and characterizes what changed between two satellite images, is central to disaster response and environmental monitoring, spanning change detection, building localization, and damage assessment. Strong vision-language models address these tasks, but adapting them typic...
Haruki Watase, Shunya Nagashima, T. Nishimura· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.