---
title: "Tsinghua's Open-MOPD Merges Expert AI Models Into One, Recovering 83% of Lost Performance"
subtitle: "A new open recipe from Tsinghua and ByteDance diagnoses why merging multiple RL specialists into one model fails, and more than doubles capability recovery."
url: "https://alphasignal.ai/news/tsinghua-s-open-mopd-merges-expert-ai-models-into-one-recovering-83-of-lost"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-08-19T16:50:39.000Z"
updated: "2026-08-22T01:15:15.895Z"
type: "Paper"
topics:
  - "Post Training"
  - "Open Source"
subtopics:
  - "Distillation"
  - "Rl"
  - "Fine Tuning"
upvotes: 276
source_url: "https://arxiv.org/abs/2608.19098"
comments: 0
truncated: true
---

# Tsinghua's Open-MOPD Merges Expert AI Models Into One, Recovering 83% of Lost Performance

> A new open recipe from Tsinghua and ByteDance diagnoses why merging multiple RL specialists into one model fails, and more than doubles capability recovery.

Merging several domain-expert LLMs into a single generalist student sounds like a solved problem in industry pipelines, but the recipe has stayed mostly behind closed doors. A new paper called [Open-MOPD](https://arxiv.org/abs/2608.19098), from Tsinghua University and ByteDance Seed, is the first fully reproducible attempt to pull that pipeline apart, figure out why it fails, and fix it on hardware most labs can actually afford.

Standard multi-teacher on-policy distillation captures only 35.6% of the available headroom relative to a domain-routed oracle ensemble, with concise tasks such as instruction following suffering severe degradation and premature stagnation. With three targeted fixes, the authors push that recovery to 83.4% in a single deployable student.

## Too many specialists, one deployment slot

Post-training with reinforcement learning is good at cultivating narrow skills. You can build a math expert, a coding expert, and an instruction-following expert independently, each with its own reward signal. Serving three models is expensive, and mixing their training data through Mix-RL, Cascade RL, or parameter merging tends to produce see-saw effects, where improving one domain degrades another, or catastrophic forgetting, where a model loses previously learned skills during sequential training.

Multi-teacher on-policy distillation, or M-OPD, is the paradigm that has been quietly winning inside frontier labs. In the recently published [MOPD paper](https://arxiv.org/abs/2606.30406), the method was shown to work on Qwen3-30B-A3B and inside the industrial-scale [MiMo-V2-Flash](https://arxiv.org/html/2601.02780v2) pipeline. The idea: first run per-domain specialised RL to obtain a set of domain teachers, then distill these teachers into the student on its own rollouts. This eliminates exposure bias and provides a dense optimization signal. The student generates, the appropriate domain teacher scores every token, gradients flow.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [Open-MOPD: Diagnosing and Fixing Capability Imbalance in Multi-Teacher On-Policy Distillation](https://arxiv.org/abs/2608.19098)
- [MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training](https://arxiv.org/abs/2606.30406)
- [MiMo-V2-Flash Technical Report](https://arxiv.org/html/2601.02780v2)
- [Open-MOPD HTML full paper](https://arxiv.org/html/2608.19098)
- [SmolLM3 from HuggingFace](https://mlops.substack.com/p/smollm3-from-huggingface)