Comfy-Org Brings YuE2 Music Generation Natively Into ComfyUI Workflows
Comfy-Org has repackaged the MAP team's YuE2 music model into single-file safetensors, and ComfyUI now ships native nodes to run it.
- Comfy-Org published repackaged YuE2 safetensors for direct use inside ComfyUI.
- Two files: a 3B checkpoint for checkpoints/ and a SheetSage2 audio encoder for audio_encoders/.
- Native ComfyUI support lands via PR #16250, adding diffusion transformer, VAE, and generation nodes.
- Underlying model is MAP's YuE2-3B, lyrics-to-song with an editable symbolic score layer.
- Licensed CC BY-NC 4.0, so outputs cannot be used commercially.
- Known rough edges: occasional ABC generation failures and high VRAM during the acoustic synthesis stage.
The Comfy-Org team has published YuE2 checkpoints packaged for ComfyUI. A companion pull request adds native loading, score generation, acoustic synthesis, and audio decoding to ComfyUI core. Once that work lands, developers can generate songs from lyrics and a style prompt without installing YuE2’s Python inference wheel or a community wrapper node.
The release repackages weights from the Multimodal Art Projection team’s YuE2-3B, a 3 billion-parameter music model that generates vocals and accompaniment. YuE2 first produces an editable symbolic plan containing melody and chords, then renders that plan as stereo audio. Comfy-Org converted the existing weights into single-file checkpoints that fit ComfyUI’s model-loading conventions.
Two files power the workflow
The Comfy-Org repository contains BF16 conversions of YuE2-3B and its SheetSage2 audio encoder. BF16, or bfloat16, reduces memory use compared with full 32-bit precision while retaining a wide numerical range. Safetensors provides a single-file weight format designed for predictable, code-free loading.
| File | Purpose | ComfyUI directory |
|---|---|---|
yue2_3b_bf16.safetensors |
YuE2 generation checkpoint | ComfyUI/models/checkpoints/ |
sheetsage2_bf16.safetensors |
SheetSage2 audio encoder | ComfyUI/models/audio_encoders/ |
Both files derive from the upstream m-a-p/YuE2-3B and m-a-p/SheetSage2 releases. The repository lists the weights under CC BY-NC 4.0, so commercial projects should review the license before adopting them.
This story is for Pro members
You've reached the end of the free preview. Upgrade to AlphaSignal Pro to read the full article - and everything else behind the paywall.
Comments
