Automatic music transcription has been a stubborn open problem for decades. Drop a full band recording into any existing tool, and you'll get back a muddy piano roll that blends all instruments into one indecipherable blob. MuScriptor, a new open-weight model from Kyutai and Mirelo, is the first serious attempt to crack this at scale: give it any recording, in any genre, and it returns clean, per-instrument MIDI.
The wall that stopped everyone else
Multi-instrument music transcription aims to convert polyphonic music recordings into musical scores assigned to each instrument. The task is challenging because it requires simultaneously identifying multiple instruments and transcribing their pitch and precise timing, and the lack of fully annotated data adds to the training difficulties.
The 2026 paper introduces MuScriptor as an open-weight multi-instrument music transcription model that works on real-world music recordings from across a diverse range of musical genres. The prior art, Google's MT3 from 2022, was a landmark in the field but hit a ceiling almost immediately: existing methods for automatic music transcription are often limited to single-instrument recordings or fail on complex, real music mixes. Although previous work utilizes synthetic training data, the resulting models generalize poorly, leading to largely unusable transcription output in realistic, multi-instrument settings.
Don't miss what's next in AI
Join 300,000+ engineers and researchers who get the signal, not the noise.
- Full access to in-depth AI research breakdowns
- Be the first to know what's trending before it hits mainstream
- Daily curated papers, repos, and industry moves