The Tanawpamana Dataset is introduced, a repository of Philippine heritage site images with metadata based on the Talapamana registry of the National Commission for Culture and the Arts of the Philippines, comprising 4,046 tasks designed to evaluate models'recognition and knowledge of heritage sites.
Ivan Yuri De Leon, Hiroki Ouchi, S. Sakti· 0 citations
Self-supervised pretraining has expanded the pool of 3D medical foundation models, but published evaluations use different datasets, endpoints and fine-tuning protocols. Models also differ in architecture, pretraining objective and data, while downstream targets range from voxel-level masks to patient-level diagnoses a...
Recent video super-resolution (VSR) models achieve efficient one-step generation through diffusion distillation. However, high-resolution inference remains costly, and distilled models are difficult to align with human preferences. These challenges call for improvements in both model architecture and training strategy....
Ru-Chang Yao, Shi Guo, Junhao Zhuang et al.· 0 citations
Dual-encoder vision-language models systematically fail at negation, scoring ''a cat without a dog'' nearly identically to ''a cat with a dog.'' We show that this failure is inherent to the single-embedding framework. Under contrastive training, single-embedding methods can at best ignore the negated concept (dilution)...
DoYoung Kim, Changkyu Choi, Ad\'in Ram\'irez Rivera et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Recent advances in video world models have enabled plausible interactive environments, yet long-horizon generation places a fundamental demand on visual memory: the previously observed world must remain consistent as the model continues to generate. Existing autoregressive approaches often implicitly rely on the genera...
Jun-Yi Wu, Ze-Kun Li, Chenhongyi Yang et al.· 0 citations
Vision Transformers incur high computational costs when processing long visual token sequences. Existing reduction methods typically rank tokens independently and discard those deemed unimportant or redundant. We propose a reconstruction-guided framework for visual token condensation (ReConV), which summarizes the comp...
Xiaoya Tang, Shilong Liu, Daniel Smolyak et al.· 0 citations
This work introduces MID (Mask-Image Distributional Divergence), a distribution-level evaluation metric for medical image segmentation that compares the joint distribution of images and masks between a reference set and a set of predictions, without requiring sample-wise correspondence.
Vincenzo Marcianó, Xiao-Ming Zhang, Gianluca Guglielmo et al.· 0 citations
Functional brain connectome represents neural connectivity as a matrix of pairwise interactions between brain regions. Generation of functional connectomes is not only a question of validity; rather, having satisfied the constraints on the correlation matrix, the next step is to recover the class-conditional geometry b...
Protyay Dey, Ayush Roy, Hyuna Cho et al.· 0 citations
Vision-language-action (VLA) models show strong potential for end-to-end autonomous driving by leveraging world knowledge and understanding to excel in long-tail scenarios. However, current VLAs have two limitations: 1) Degeneration into vision-action (VA) models. For low latency, regression/flow-based methods directly...
Yuqi Ye, Caigao Jiang, Zhuonan Wang et al.· 0 citations
Visual in-context learning (ICL) enables vision-language models (VLMs) to adapt at test time via demonstration examples, but its effectiveness depends critically on the examples selected. Recent counterfactual selection methods improve ICL by constructing demonstrations that expose how individual attribute changes affe...
Physical AI is commonly formulated around an explicitly specified task: given a goal or instruction, a system perceives, reasons, and acts. In many real-world settings, however, important tasks emerge from continuously changing world states before a person explicitly formulates them. We study this complementary problem...
Zhenhua Yang, Jiafeng Liang, Xingyu Zhou et al.· 0 citations
Research on video classification models has witnessed significant growth recently, accompanied by a significant increase in the demand for datasets to train such models. Existing video dataset curation approaches share a common bottleneck: candidate videos must be downloaded before any relevance judgment is made, which...
Mohammed Shabot, Jonathan Adams, Jan Van den Stock et al.· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.