Skip to content
Preprint

Wan-Animate-2: Pushing the Application Boundaries of Character Animation

Aug 2026 · 3 citations · 35 references
Computer Science

TL;DR

Wan-Animate-2 is presented, an end-to-end character animation framework that directly consumes the driving video within a redesigned Diffusion Transformer and achieves superior motion fidelity and identity preservation by eliminating intermediate motion extractors entirely.

Abstract

Character image animation remains a foundational yet challenging task in computer vision. Existing approaches can be broadly categorized into three paradigms: methods based on explicit motion representations suffer from extraction errors and identity drift; methods based on implicit motion features lose fine-grained dynamics through compression; and in-context learning approaches avoid intermediate representations but incur prohibitive computational costs. Furthermore, all current systems are designed for offline synthesis, unable to meet the real-time requirements of interactive applications such as digital avatars and live-streaming hosts. To address these limitations, we present Wan-Animate-2, an end-to-end character animation framework that directly consumes the driving video within a redesigned Diffusion Transformer. Our architecture achieves superior motion fidelity and identity preservation by eliminating intermediate motion extractors entirely. We further introduce text driven viewpoint control that decouples the output camera perspective from the driving video--a capability rarely supported by prior character animation methods that rely on explicit motion representations. Beyond generation quality, we present Wan-Animate-2-Lite, an efficient variant that reduces inference latency to real-time thresholds through a three-stage training paradigm: teacher forcing pretraining with error buffer mechanism, and Self-Forcing distillation with chunk-wise backpropagation. This enables streaming character animation for interactive applications, opening new deployment scenarios that were previously infeasible. Qualitative evaluations and user studies demonstrate that Wan-Animate-2 achieves high-fidelity animation results across diverse characters and motion patterns. To foster further research and community development, we will release the Wan-Animate-2-Base model weights to the public.

View source

Similar papers

Jul 2026

MultiAnimate: A Unified Framework for Controllable Multi-Character Animation

MultiAnimate is introduced, a comprehensive framework that enables concurrent animation of multiple characters within a shared environment while preserving both identity consistency and spatial relationships and demonstrates its superiority in multiple character animation, particularly in scenarios involving complex mo...

Zhongyi Zhang, Guangyuan Wang, Liucheng Hu et al. · 0 citations
Preprint Aug 2026

LiveAnimate: Stable Long-Form Streaming Human Animation in Real-Time

This work presents LiveAnimate, to their knowledge the first animation system to combine real-time streaming with stable long-form generation at billion scale, built on a 14B-parameter video Diffusion Transformer (DiT).

Yuxuan Zhang, H. Xiong, Yubo Huang et al. · 1 citation
Open access Aug 2026

AnyTalk: Speech Animation for Arbitrary Characters Leveraging a Video Generation Model.

AnyTalk enables lip-synced animations across diverse face meshes and blendshape configurations, significantly reducing manual effort and data requirements and enhances usability by distilling AnyTalk into a streamlined network, $\text{AnyTalk}_{RT}$, thereby enabling real-time performance.

Kwan Yun, Serin Yoon, Sun-Jin Jung et al. · 0 citations
Preprint Aug 2026

Erase but Preserve: Controllable Removal of Copyrighted Animation Characters via Optimized Semantic Anchors

The exceptional generation capabilities of text-to-image diffusion models have raised copyright concerns, particularly the unauthorized reproduction of animation characters. Existing concept erasure methods fall short for animation character erasure: model modification methods struggle to identify suitable anchors for...

Qiao Li, Xiaomeng Fu, Wangjia Yu et al. · 0 citations
Book Open access Jul 2026

Trajectory-Guided Frame Interpolation for Anime-Style Toon Effects

A machine learning–based pipeline for controllable generation of anime-style fluid effects that enables artists to generate temporally coherent animations by specifying only the first and last frames of the target sequence and sparse motion trajectories of selected points.

Julia Joanna Chylak · 0 citations
Preprint Aug 2026

EditaLive! Unified Character Video Editing for Live Streaming

Conventional video editing primarily focuses on scene-level content, whereas live streaming places greater emphasis on the human subject. However, directly applying existing video-editing methods to human-centric live streaming remains challenging, as they may introduce facial-expression inconsistencies and typically d...

Zhiyuan Li, Chi-Man Pun, Peng-Tao Jiang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.