A multimodal dog-fingerprinting framework combining visual identification, multiple-object tracking, and canine vocal fingerprinting to associate bark events with individual dogs while maintaining persistent profiles is presented.
Aryahvishwa Babu, Kingsley Jin, Li-Lin Wang et al.· 0 citations
While foundation models and vision transformers (ViTs) have redefined visual representations, current active learning (AL) strategies for these backbones largely operate at the patch or region level, where annotation requirements remain high due to extensive pixel labeling. Extending ViT-based AL to the pixel-level, lo...
Utku Cicek, Mahipal Singh, Zi-Yao Shang et al.· 0 citations
Representation alignment improves and accelerates diffusion training by encouraging intermediate features to match a pretrained visual encoder. However, standard alignment matches pretrained representations without distinguishing what information may be more useful for generation. We introduce local appearance purifica...
Yingheng Wang, Yao Li, Ya-Qin Wu et al.· 0 citations
It is shown that coarse hazard recognition does not imply reliable fine-grained defensive-driving reasoning and motivate geographically diverse safety evaluation, and all models show weak latent-hazard anticipation and near-zero self-reported trap recognition.
A. Al Maruf, Md. Sajedul Islam, Tanmoy Mridha et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
This work introduces Page-to-Token Policy Optimization (P2TPO), a structure-aligned credit-assignment framework that operates on full-page policy trajectories that outperforms all evaluated policy optimization baselines in seed-averaged scores on each of the six document parsing benchmarks.
Yong-Zhou-Shi-、-Lan-Shan-Xian-Ti-Gai-Wei-Lian-He-D Zu, Ning-Hua Yang, Ze-Zhong Tan et al.· 0 citations
Post-hoc image explanations usually show where a model looks using spatial heatmaps or indicate which channels matter using global channel scores. These separate views are limiting for multispectral data because channel relevance is often spatially localized and physically meaningful. We introduce Spectral-Spatial Inte...
Haotian Ma, Ruqi Yang, Philip Townsend· 0 citations
Improving the reasoning capabilities of vision-language models (VLMs) often relies on post-training with supervision from stronger models. Two common strategies are supervised fine-tuning (SFT), which trains on teacher-generated demonstrations, and on-policy distillation (OPD), which provides teacher feedback on trajec...
Frank Yang, Kefei Yan, Yi-Ren Wang et al.· 0 citations
Learning informative representations of mechanical Triply Periodic Minimal Surface (TPMS) metamaterials is important for mechanics analysis and structural design, yet existing methods have rarely explicitly supervised learned representations with information about global structural connectivity that is relevant to mech...
Songlin Duan, Shuo Yang, Yujia Zheng et al.· 0 citations
Sampling from continuous flow-based generators such as flow matching models requires numerical ODE or SDE integration, making inference cost depend on the number of function evaluations (NFEs). In practice, the sampling budget is inherited from prior work or selected through expensive FID-versus-NFE sweeps, using FID t...
Zahra Dehghani, Pablo Piantanida, Mohammadhadi Shateri· 0 citations
This work derives a Latent Consistent Proximal (LCP) solver that evolves each latent variable from its previous state rather than reconstructing through an indirect residual, and stabilizes small target updates through task-adaptive normalization and gain control.
Tianfang Zhang, Feng-Yi Wu, Lei Li et al.· arXiv.org· 0 citations
Multimodal Large Language Model (MLLM)-based web agents provide practical, high-precision solutions for visual browser automation; however, they inherently expand the attack surface, introducing novel vision-based vulnerabilities. Existing adversarial evaluations targeting these agents frequently rely on permissive thr...
Xuelong Dai, Jianyu Ma, Boyang Ma et al.· 0 citations
Video multimodal large language models (MLLMs) have made rapid progress in general and long-form video understanding, yet their ability to capture and use brief, answer-critical visual evidence remains underexplored. Momentary actions or state transitions may determine an answer while occupying only a small fraction of...
Xiaolin Liu, Yilun Zhu, Xiangyu Zhao et al.· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.