Mesh Avatar Studio Lets Claude Rig 2D VTuber Avatars Automatically
A single illustration plus a coding agent becomes a face-tracked VTuber avatar that blinks, talks, and streams straight into OBS.
- Mesh Avatar Studio turns one illustration into an animated 2D VTuber rig, hitting ~1.8k GitHub stars under MIT license.
- A coding agent (Claude Code or Codex) places the mesh, cuts layers and reviews poses from
docs/agent-guide.md. - Codex can run the full pipeline with
npm run create -- image.png, including drawn eyes and mouths via OpenAI image generation. - Local WebGL editor lets you drag control points on parts, test lip sync with kana text, and rebuild layers on demand.
- Live page streams to OBS via a Browser Source with transparent background; face and body tracking run locally with MediaPipe.
- Browser-based Player and experimental Rust native runtime both load the same portable
.mavatarfiles.
Mesh Avatar Studio turns a static illustration into an animated, VTuber-style 2D avatar. A coding agent handles mesh placement, layer cutting, eye and mouth variants, and initial rigging; a local editor provides the controls for refining the result.
The MIT-licensed project has attracted roughly 1,800 GitHub stars. It runs locally, renders through WebGL, and uses MediaPipe for face tracking. Finished avatars can blink, speak, turn, breathe, and move their hair. An experimental Rust runtime supports native playback.
The Agent Builds the Rig
Rigging converts a flat drawing into independently controlled regions such as the face, eyes, mouth, hair, and accessories. Mesh handles define how those regions deform as tracking values change. Preparing them manually requires careful coordinate work, layer masks, expression art, and repeated pose checks.
Mesh Avatar Studio gives that work to Claude Code or Codex through a repository guide. The agent checks coordinate accuracy on zoomed grids, places control points, cuts the source image into layers, and reviews fixed poses for deformation errors. Generated projects stay in the git-ignored projects/ directory.
The documentation recommends Claude Opus 5.5 with Claude Code or GPT-6.1 Sol with Codex. From a checked-out repository with its dependencies installed, Codex can run the pipeline with one command:
This story is for Pro members
You've reached the end of the free preview. Upgrade to AlphaSignal Pro to read the full article - and everything else behind the paywall.
Comments
