Comfy-Org Brings YuE2 Music Generation Natively Into ComfyUI Workflows
Comfy-Org has repackaged the MAP team's YuE2 music model into single-file safetensors, and ComfyUI now ships native nodes to run it.
- Comfy-Org published repackaged YuE2 safetensors for direct use inside ComfyUI.
- Two files: a 3B checkpoint for checkpoints/ and a SheetSage2 audio encoder for audio_encoders/.
- Native ComfyUI support lands via PR #16250, adding diffusion transformer, VAE, and generation nodes.
- Underlying model is MAP's YuE2-3B, lyrics-to-song with an editable symbolic score layer.
- Licensed CC BY-NC 4.0, so outputs cannot be used commercially.
- Known rough edges: occasional ABC generation failures and high VRAM during the acoustic synthesis stage.
YuE2 music generation moves toward native ComfyUI support
The Comfy-Org team has published YuE2 checkpoints packaged for ComfyUI. A companion pull request adds native loading, score generation, acoustic synthesis, and audio decoding to ComfyUI core. Once that work lands, developers can generate songs from lyrics and a style prompt without installing YuE2’s Python inference wheel or a community wrapper node.
The release repackages weights from the Multimodal Art Projection team’s YuE2-3B, a 3 billion-parameter music model that generates vocals and accompaniment. YuE2 first produces an editable symbolic plan containing melody and chords, then renders that plan as stereo audio. Comfy-Org converted the existing weights into single-file checkpoints that fit ComfyUI’s model-loading conventions.
Two files power the workflow
The Comfy-Org repository contains BF16 conversions of YuE2-3B and its SheetSage2 audio encoder. BF16, or bfloat16, reduces memory use compared with full 32-bit precision while retaining a wide numerical range. Safetensors provides a single-file weight format designed for predictable, code-free loading.
| File | Purpose | ComfyUI directory |
|---|---|---|
yue2_3b_bf16.safetensors |
YuE2 generation checkpoint | ComfyUI/models/checkpoints/ |
sheetsage2_bf16.safetensors |
SheetSage2 audio encoder | ComfyUI/models/audio_encoders/ |
This story is for Pro members
You've reached the end of the free preview. Upgrade to AlphaSignal Pro to read the full article - and everything else behind the paywall.
Comments
