Skip to content

Diffusion Editing with Soft Mask: Pixel Level Redo of Image and Video with Adjustable Strength

Sep 2026 · 0 citations · 40 references
Computer Science

TL;DR

This work introduces SoftPaint, a new zero-shot sampling method that leverages soft masks to enable a continuous spectrum of edits, from fully preserving the original content to completely re-synthesizing the masked region.

Abstract

Diffusion models with prompt and reference image-guided editing have seen rapid progress, yet they remain too coarse for pixel-level control. One promising direction is to incorporate a soft mask that specifies spatially varying edit strengths but training such fine-grained control demands expensive pixel-wise annotations, while existing zero-shot methods often yield unsatisfactory results. We introduce SoftPaint, a new zero-shot sampling method that leverages soft masks to enable a continuous spectrum of edits, from fully preserving the original content to completely re-synthesizing the masked region. Going beyond zero-shot inpainting methods, we design a Langevin-iteration-based sampler that respects per-pixel soft mask strengths, which applies universally to image and video diffusion models, enabling tasks such as video editing. The method is gradient-free, memory-efficient, and achieves smooth, pixel-level edits across multiple image and video backbones.

View source

Similar papers

Preprint Nov 2026

RAGE: Residual-Adaptive Gating for Flow-Based Image Editing

Recent inversion-free, flow-based image editing methods evolve the source image toward the target via a differential velocity field. We observe that this velocity field does not explicitly account for which regions should be preserved, leading to unintended drift in non-editing regions. To address this, we formulate so...

Ruo-Feng Mei, Xiang-Yu Xu · 0 citations
Preprint Oct 2026

LOCI: Localized Continuous Control for Multi-Subject Image Editing

Recent instruction-following image editors such as Flux.1-Kontext enable text-driven editing but lack fine-grained control over where and how much an edit is applied. Existing approaches provide either continuous but global control or spatially localized editing at a fixed strength. To our knowledge, none jointly suppo...

Sai Vidyaranya Nuthalapati, S. Mishra · 0 citations
Preprint Nov 2026

StitchEdit: Stitching Depth Priors into Image Editors via Per-Layer Gradient Probing

Text-guided image editing with diffusion models struggles with spatial edits (e.g. manipulating objects, changing viewpoints, manipulating occlusions) that depend on the 3D structure understanding of a scene. Marigold and follow-up work demonstrate that a pretrained diffusion backbone already harbors strong geometric p...

Qin Guo, Dan Xu · 0 citations
Preprint Oct 2026

Transforming Image Editors into Video Editors

Recent image editing systems have achieved impressive semantic understanding, visual fidelity, and instruction-following ability, while video editing remains substantially more difficult and costly. In this paper, we present a simple alternative to end-to-end video editing: instead of training a monolithic video editor...

Feng Wang, Zi-Jie Li, Ce-Yuan Yang et al. · 0 citations
Sep 2026

Zero-Shot Object Removal via Attention Masking, Latent Anchoring, and Refinement

This paper proposes a zero-shot framework for constrained latent inpainting with a frozen pretrained Stable Diffusion model, requiring no task-specific training or model fine-tuning and demonstrates effective object removal and context-consistent replacement content.

Arman Taghizadeh, U. Krumnack, Kai-Uwe Kühnberger · 0 citations
Preprint Oct 2026

EditDistill: Is It Possible to Guide Video Editing with Image Editing?

Recent advances in image editing have enabled fine-grained and highly controllable visual modifications. However, achieving similar levels of controllability in video editing remains an open challenge, particularly for precise local edits, dynamic temporal effects, and consistent lighting across frames.In this paper, w...

Guo-Jun Lei, Hong Li, Hong-Bing Yang et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.