Skip to content

Category

computer vision

3,920 papers

#machine learning Preprint Nov 2024

Red-Teaming Text-to-Image Models via In-Context Experience Replay and Semantic-Preserving Prompt Rewriting

ICER is a black-box framework that addresses the gap in text-to-image models in harmful content generation through two components: an LLM-based rewriter that produces fluent, natural-language adversarial prompts, and in-context experience replay that accumulates successful jailbreaking patterns into a reusable prior.

Zhi-Yi Chin, Pin-Yu Chen, Wei-Chen Chiu et al. · 2 citations
#machine learning Preprint Sep 2026

On-Policy Self-Distillation for Multi-Turn Image Editing

MT-OPSD is proposed, an on-policy self-distillation framework that trains the model on self-generated conditioning states with editing supervision from a clean-conditioned teacher, without requiring multi-turn annotations, and substantially improves long-horizon editing success and reduces multi-turn collapse.

Liang-Bing Zhao, Le Zhuo, Mohamed Elhoseiny · 0 citations
#machine learning Preprint Sep 2026

From internal representations to model improvement through prediction errors

It is suggested that linking a model's internal features to its errors and their effects on performance may help select training images that improve performance, thereby allowing the model's current state to guide which images are labeled next.

Yushi Nakaya, K. Higuchi, Shuichi Ishida · 0 citations
#machine learning Preprint Sep 2026

Scaffold Then Internalize: Representation Injection for Diffusion Transformers

This work introduces REPI, a training framework based on a scaffold-to-internalization strategy, in which projected encoder representations initially serve as a temporary scaffold and are then progressively internalized by the diffusion transformer.

Han-Si Fu, Jia-Cheng Chen, Bao-Quan Zhao et al. · 0 citations
#machine learning Preprint Sep 2026

AnswerMap: Faithful Spatial Interpretability of VLMs from Answer Posteriors

AnswerMap is introduced, a training-free, task-agnostic, black-box visual rationale constructed from the output head that offers a new lens on VLM interpretability and, through its read-outs, a new output interface for visual tasks beyond text tokens.

Mohamed Eltahir, Fardows Adam, Duaa M. Tahir et al. · 0 citations
#machine learning Preprint Sep 2026

Beyond Selection: Token Parameterization for Extreme Visual Token Compression

Braco is a lightweight four-step coder that combines transform-basis truncation, input-independent basis-coordinate embeddings, budget-dependent orthogonal re-parameterization, and learned spatial residual tokens from lightweight pooling that forms the favorable empirical accuracy-efficiency frontier under compression.

Rui-Lian Zhong, Yu Li, Zhe-Yu Yan et al. · 0 citations
#machine learning Preprint Open access Sep 2026

G$^3$-LoRA: Organizing Reward-Weighted Video Data with Gradient-Guided Grouped LoRA

Post-training foundation video models on heterogeneous reward-weighted data usually assume that all data categories induce compatible updates. This assumption is fragile when categories correspond to different skills, domains, or evaluation dimensions. We study this problem in text-to-video post-training, where VBench2...

Jia Song (The Hong Kong University of Science and Technology), Wenhow Li (The Hong Kong University of Science and Technology), Lichen Bai (The Hong Kong University of Science and Technology) et al. · 0 citations
#machine learning Preprint Open access Sep 2026

DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detection

Deepfake detection methods have become increasingly effective yet most provide limited insight into the evidence behind their predictions. However, in forensic settings users also need to know which manipulation cues support the decision and where they appear. Existing explainability methods only partially address this...

Georgios Tsoumplekas, Vazgken Vanian, Alexandros Doumanoglou et al. · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

Microsoft Research Blog Oct 6, 2026

What AI gets wrong and what failure teaches us

Jennifer Neville did not want to go into computer science—but that’s exactly where she landed. Neville discusses the starts and stops that led to her professional sweet spot and her work identifying “surprising failures” making it hard for AI to handle complexity.  The post What AI gets wrong and what failure teaches us appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.