Alibaba's Wan-Animate-2 Beats Proprietary Platforms Without a Single Skeleton
Alibaba's Wan-Animate-2 ditches pose skeletons entirely, achieving real-time streaming character animation at 24 FPS with open weights under Apache 2.0
- No more pose skeletons: Wan-Animate-2 feeds raw video latents directly into a Diffusion Transformer, eliminating extraction errors and identity drift.
- Real-time streaming: The Lite variant runs at 24 FPS at 400×720 on 4× H100s, the first open-source system to hit real-time thresholds for character animation.
- Text-controlled camera: A Viewpoint LoRA trained on ~50K Unreal Engine renders lets you change camera angle via text prompts, decoupled from the driving video.
- Beats commercial platforms: In a blind user study, Wan-Animate-2 outperformed Dreamina and matched Kling-MotionControl, both built on larger proprietary models.
- Fully open-source: Weights available on HuggingFace under Apache 2.0, with diffusers, ComfyUI, and DiffSynth-Studio integrations.
- Multi-character support: Animate multiple characters simultaneously in one scene, each retaining distinct identity and motion.
Character animation has long been a two-step dance: extract a skeleton or pose from a driving video, then warp a reference character to match it. The skeleton is the bottleneck. It loses hand detail, drifts when body shapes differ, and completely locks the output camera to whatever angle the driving video was filmed at. Wan-Animate-2, the new open-source release from Alibaba's Tongyi Lab, throws out the skeleton entirely and replaces it with something more direct: the raw video latents themselves.
No pose extraction, no problem
Character image animation aims to transfer the spatiotemporal motion features from a driving video to a reference image containing a specific subject to generate an animated video. The field has tried three approaches to do this, and each has a fatal flaw:
- Explicit pose methods (skeletons, SMPL body meshes): fast and interpretable, but extraction errors compound, and cross-identity transfer breaks when body shapes differ significantly.
- Implicit motion encoders: compress the driving video into a learned latent, avoiding skeleton errors, but the compression bottleneck discards fine-grained dynamics like subtle hand movements and micro-expressions.
- In-context learning: feed the raw driving video directly into the model's attention , no intermediate representation at all. Best quality, but full-sequence self-attention over all reference and target tokens is quadratically expensive and practically unusable at scale.
Leading closed-source video generation platforms now increasingly incorporate character animation as a built-in capability, while the open-source community has yet to produce systems of comparable quality, widening the gap between proprietary and publicly available solutions. Wan-Animate-2 is a direct attempt to close that gap.
The architecture: four interlocking ideas
Wan-Animate-2 is a novel end-to-end character animation framework that directly consumes driving videos in a redesigned Diffusion Transformer, which achieves high-fidelity motion generation and strong identity preservation by eliminating intermediate motion extractors. The key insight is that the reference video's own latents are already a complete motion prior , no skeleton needed. Four architectural components make this work at scale: