---
title: "UniPROT Fixes a Hidden Bias That Hurts Minority Classes in AI Training Data"
subtitle: "A new subset selection method forces equal weights on chosen prototypes, boosting minority class accuracy and LLM training on imbalanced data mixtures."
url: "https://alphasignal.ai/news/uniprot-fixes-a-hidden-bias-that-hurts-minority-classes-in-ai-training-data"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-04-13T00:00:00.000Z"
updated: "2026-08-24T03:20:46.334Z"
type: "Paper"
topics:
  - "Data"
  - "Post Training"
subtopics:
  - "Data Curation"
  - "Synthetic Data"
  - "Fine Tuning"
upvotes: 1199
source_url: "https://arxiv.org/abs/2604.10952"
comments: 0
truncated: true
---

# UniPROT Fixes a Hidden Bias That Hurts Minority Classes in AI Training Data

> A new subset selection method forces equal weights on chosen prototypes, boosting minority class accuracy and LLM training on imbalanced data mixtures.

Picking a small, representative subset from a large dataset sounds like a solved problem. Facility location, k-medoids, and their optimal transport cousins have been doing this for years. There is a subtle bug in how these methods work though: they hand out uneven importance weights to the prototypes they pick, and minority classes almost always get the short end of the stick.

A new paper accepted at AISTATS 2026 introduces [UniPROT](https://arxiv.org/abs/2604.10952), a subset selection framework that forces every selected prototype to carry equal weight, and proves you can still get the classic `(1 - 1/e)` greedy approximation guarantee while doing it. The approach delivers measurable gains on long-tailed image classification and, more interestingly, on mini-batch selection for LLM fine-tuning and pretraining.

## Why weighted prototypes quietly hurt minorities

Classical prototype selection methods pick a subset whose induced distribution is close to the target under some divergence, typically maximum mean discrepancy or Wasserstein distance. These algorithms often yield a weighted subset of representative instances, where the weights reflect the relative importance of each exemplar and are typically inferred implicitly during selection.

That implicit weighting causes trouble. Uniform weighting is generally preferred for interpretability, since disproportionate emphasis can bias human perception. The issue sharpens under long-tailed class distributions, where minority classes may receive lower-weighted prototypes, leading to unfair or under-representative selections. When the authors ran vanilla k-medoids on CIFAR10, the learned weights were heavily skewed, meaning several selected prototypes contributed almost nothing to the actual reconstruction of the target distribution.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [UniPROT: Uniform Prototype Selection via Partial Optimal Transport with Submodular Guarantees](https://arxiv.org/abs/2604.10952)
- [UniPROT GitHub Repository](https://github.com/efficiency-learning/UniPROT)
- [MathInstruct (MAmmoTH)](https://arxiv.org/abs/2309.05653)
- [Python Optimal Transport (POT) Library](https://pythonot.github.io/)