Vision-Language-Action (VLA) models have recently incorporated world models to provide richer dynamic supervision beyond sparse action labels. However, explicitly predicting future images or videos may include control-irrelevant appearance, while guidance derived from holistic future visual representations and shared g...
This work proposes to reframe the diffusion MRI problem as an object detection-like task, adopting the Detection Transformer (DETR) architecture to jointly predict mean diffusivity, fractional anisotropy, main fiber direction, and signal fraction for a variable number of compartments per voxel from standard multi-shell...
Sebastian Endt, Marcus Wirth, Johannes Reinhold Schlund et al.· 0 citations
Interactive video generation (IVG) models have achieved remarkable progress in producing controllable visual content guided by user-defined actions, yet their security vulnerabilities remain largely unexplored. In this paper, we present the first systematic study of backdoor attacks against the interactivity of IVG mod...
Zhihang Wu, Zhongqi Wang, Jie Zhang et al.· 0 citations
Metal additive manufacturing parts are inspected by X-ray computed tomography, where labelled data is scarce, the pores and inclusions that matter span a few pixels, and inspection must happen at the machine. We present DCM-SAM, a defect-conditioned adaptive mixture of LoRA experts: one frozen Segment Anything backbone...
Md Mushfiqur Rahaman, Md Mahedi Hasan, Imtiaz Ahmed et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
A rollout-based training framework that recovers full supervision through two complementary components, Anchor-Label Relabelling (ALR) and In-Rollout Anchors (IRA), that increases greedy accepted length by up to 36.5% over DFlash and consistently outperforms erasing baselines.
Jungseob Lee, Chanjun Park, Sugyeong Eo et al.· 1 citation
We introduce Scene Text Editing with Preserved Style (STEPS), a novel diffusion model architecture for quality text replacement in images. Scene Text Editing (STE), also known as Visual Text Editing, consists of changing the textual content in an image while conserving the original style, e.g. font, colors, orientation...
Nicolas Thiébaut, Nameer Hirschkind, Xiao Yu et al.· Pacific-Asia Conference on K...· 0 citations
While Vision-Language-Action (VLA) models enable flexible action generation, their generalization across diverse environmental elements, including manipulated objects, destinations, and backgrounds, is limited by the lack of diversity in robotic training data. Trained end-to-end on such data, VLAs tend to exploit visua...
Yan-Yan Zhang, Di-Sheng Liu, Xin-Peng Li et al.· 0 citations
Egocentric gaze prediction enables many downstream applications but remains challenging, as human gaze is inherently stochastic. This stochasticity is constrained by structured temporal dynamics alternating between fixations and saccades, top-down influences from tasks, and bottom-up visual saliency. Based on this obse...
Unified multimodal models (UMMs) train image understanding and autoregressive image generation on shared parameters, and the two objectives are known to interfere. Existing diagnoses and remedies operate at the resolution of layers or experts, measuring conflict per layer and resolving it by separating parameters. We a...
Shuyang Jiang, Fucheng Deng, Yuchuan Luo et al.· 0 citations
Vision Language Models (VLMs) are widely deployed in safety-critical scenarios, and understanding to which extent they can be controlled by adversarial perturbation is a prerequisite for evaluating their trustworthiness. Existing representation-alignment attacks, which make a VLM perceive a target image, achieve limite...
Multimodal large language models (MLLMs) are rapidly advancing clinical diagnosis, yet their adaptation pipelines remain anchored to accuracy-based objectives. Clinical data are heavily class-imbalanced: a constant-majority predictor can score above 90% accuracy while being clinically useless. We therefore evaluate and...
Tian Xia, Minghao Liu, Yiqing Liang et al.· 0 citations
Rank-constrained tensor neural networks reduce the parameterization of high-order inputs, but they do not explicitly constrain class geometry in the learned representation. This study investigates whether a differentiable prototype-rule can provide a complementary inductive bias for Rank-R tensor learning under limited...
Eftychios Protopapadakis, Konstantinos Makantasis, Konstantinos M. Giannoutakis· 0 citations
Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity. The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.
Computer scientist, entrepreneur, and philanthropist will collaborate with the MIT Schwarzman College of Computing to advance AI and scientific discovery.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.