---
title: "CVPR 2026's OTC Beats Catastrophic Forgetting by Treating Classes as Moving Mixtures"
subtitle: "A new continual learning method uses optimal transport to grow multiple adaptive cluster centers per class, cutting forgetting on streaming data."
url: "https://alphasignal.ai/news/cvpr-2026-s-otc-beats-catastrophic-forgetting-by-treating-classes-as-moving"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-04-15T00:00:00.000Z"
updated: "2026-08-23T22:44:47.144Z"
type: "Paper"
topics:
  - "Post Training"
  - "Benchmarks"
subtopics:
  - "Distillation"
  - "Fine Tuning"
upvotes: 4424
source_url: "https://arxiv.org/abs/2211.16780"
comments: 0
truncated: true
---

# CVPR 2026's OTC Beats Catastrophic Forgetting by Treating Classes as Moving Mixtures

> A new continual learning method uses optimal transport to grow multiple adaptive cluster centers per class, cutting forgetting on streaming data.

Training a model on a never-ending stream of new classes is one of the ugliest problems in machine learning. You do not get to loop over the data, you cannot store much of it, and each new mini-batch quietly rewrites the features the model learned yesterday. A paper accepted at CVPR 2026, [An Optimal Transport-driven Approach for Cultivating Latent Space in Online Incremental Learning](https://arxiv.org/abs/2211.16780), proposes a fix that treats each class as a moving mixture of Gaussians and updates it with cheap gradient steps instead of the usual EM iterations.

## The setting nobody likes: online class-incremental learning

Online Class Incremental Learning (OCIL) is the hardest flavor of continual learning. Data arrives as small batches, the class distribution shifts over time, the model is only allowed a single update per batch, and at inference time you do not know which task a sample came from. Most methods stash a small replay buffer and try to keep old classes recognizable, but they still fight catastrophic forgetting: previously learned features drift as the backbone chases new data.

The dominant trick has been to represent each class by a prototype in latent space and pull samples toward it. Some approaches use one adaptive centroid per class, others use several fixed centroids fit with a Gaussian Mixture Model. Both have known weaknesses. A single prototype cannot capture a class whose data splits into several visual modes, and fixed GMM centroids go stale because the latent space keeps shifting as the model adapts to new data. MMOT addresses this by flexibly updating centroids with gradient descent instead of EM, which would require multiple inner iterations per learning step.

![t-SNE of latent space with a single adaptive centroid per class](https://arxiv.org/html/2211.16780v4/1_cen.png) 

## Turning a mixture model into a transport problem

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [An Optimal Transport-driven Approach for Cultivating Latent Space in Online Incremental Learning (arXiv)](https://arxiv.org/html/2211.16780)
- [CVPR 2026 open-access paper PDF](https://openaccess.thecvf.com/content/CVPR2026/papers/Tran_An_Optimal_Transport-driven_Approach_for_Cultivating_Latent_Space_in_Online_CVPR_2026_paper.pdf)
- [POT: Python Optimal Transport library](https://github.com/PythonOT/POT)