---
title: "Tsinghua's CPM-Bee Brings Open-Source Bilingual AI to Consumer GPUs"
subtitle: "OpenBMB's CPM-Bee is a 10B open-source bilingual base model trained on over a trillion tokens, with commercial use allowed and four size variants from 1B to 10B."
url: "https://alphasignal.ai/news/tsinghua-s-cpm-bee-brings-open-source-bilingual-ai-to-consumer-gpus"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-07-07T14:05:53.000Z"
updated: "2026-07-07T19:37:57.956Z"
type: "Repo"
topics:
  - "Llms"
  - "Open Source"
subtopics:
  - "Small Models"
upvotes: 3043
source_url: "https://github.com/OpenBMB/CPM-Bee"
comments: 0
truncated: true
---

# Tsinghua's CPM-Bee Brings Open-Source Bilingual AI to Consumer GPUs

> OpenBMB's CPM-Bee is a 10B open-source bilingual base model trained on over a trillion tokens, with commercial use allowed and four size variants from 1B to 10B.

[CPM-Bee](https://github.com/OpenBMB/CPM-Bee) is a 10-billion-parameter, open-source Chinese-English bilingual base model from [OpenBMB](https://www.openbmb.cn/en/about-us), the open-source community co-founded by Tsinghua University's NLP Lab (THUNLP) and ModelBest Inc. It is free to use, commercially licensable, and ships in four compressed sizes that can run on consumer GPUs. If you're building applications that need strong Chinese language understanding alongside solid English performance, this is one of the most capable openly available foundation models in that space.

## What it is and where it comes from

CPM-Bee is a fully open-source, commercially-usable Chinese-English bilingual base model with a capacity of ten billion parameters, and it is the second milestone achieved through the training process of CPM-Live. OpenBMB is founded and supported by the Natural Language Processing Laboratory of Tsinghua University (THUNLP) and ModelBest Inc., and the team has a deep research foundation in natural language processing and pretrained models. 

CPM-Bee started training on October 13, 2022, and has undergone significant improvements in both foundational capabilities and performance compared to its predecessor CPM-Ant. The CPM (Chinese Pretrained Model) series has a long lineage: it includes the first Chinese large model CPM-1, the efficient CPM-2, and the controllable CPM-3\. CPM-Bee is the latest and most capable chapter in that story.

## A trillion tokens and a structured twist

Utilizing the Transformer auto-regressive architecture, CPM-Bee has been pre-trained on an extensive corpus of trillion-scale tokens, thereby possessing remarkable foundational capabilities. Training data underwent stringent selection, cleaning, and post-processing to ensure quality, positioning it as one of the highest-volume open-source bilingual models available. 

The most distinctive architectural decision is how CPM-Bee handles input and output. Rather than accepting raw free-form text like most base models, the model input and output were designed in a JSON structured format during pre-training, enabling users to complete various tasks by simply adjusting different task fields. This means you express tasks declaratively. A translation task looks like:

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [OpenBMB/CPM-Bee GitHub Repository](https://github.com/OpenBMB/CPM-Bee)
- [CPM-Bee-10B on HuggingFace](https://huggingface.co/openbmb/cpm-bee-10b)
- [Finally! The foundation model CPM-Bee is open source now! — OpenBMB on Medium](https://medium.com/@openbmb/finally-the-foundation-model-cpm-bee-is-open-sourced-now-3cf6a0017a50)
- [OpenBMB About Page](https://www.openbmb.cn/en/about-us)
- [VisCPM — Multimodal model built on CPM-Bee](https://github.com/openbmb/viscpm)