---
title: "RPTU Benchmark Pits 15 AI Tools Against Old Stats and Old Stats Win"
subtitle: "A benchmark of 15 imputation methods across 30 datasets finds that older statistical approaches usually beat modern deep learning ones."
url: "https://alphasignal.ai/news/rptu-benchmark-pits-15-ai-tools-against-old-stats-and-old-stats-win"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-04-13T00:00:00.000Z"
updated: "2026-08-24T02:59:56.590Z"
type: "Paper"
topics:
  - "Data"
  - "Benchmarks"
subtopics:
  - "Datasets"
upvotes: 1898
source_url: "https://arxiv.org/abs/2603.24626"
comments: 0
truncated: true
---

# RPTU Benchmark Pits 15 AI Tools Against Old Stats and Old Stats Win

> A benchmark of 15 imputation methods across 30 datasets finds that older statistical approaches usually beat modern deep learning ones.

A new large-scale benchmark takes fifteen popular tools for cleaning up single-cell RNA sequencing data, throws thirty datasets at them, and comes back with a result some deep learning enthusiasts will find uncomfortable: the older, simpler statistical methods generally win. The [study](https://arxiv.org/abs/2603.24626) from researchers at RPTU Kaiserslautern-Landau and DFKI systematically compares model-based, smoothing, low-rank matrix, diffusion, GAN, GNN, and autoencoder approaches across six downstream biological tasks.

## The dropout problem, briefly

Single-cell RNA sequencing (scRNA-seq) measures gene expression one cell at a time, but the technology is noisy. Technical limitations lead to dropout events, where genes are observed as zero despite being expressed at low levels in the cell. These false zeros distort downstream analyses like clustering and trajectory inference, which is why the field has spent years building imputation methods that try to recover the true expression values.

Existing benchmarks evaluate only a limited subset of methods, datasets, and downstream analyses, and newer diffusion and GAN-based approaches were largely missing from prior comparisons. This paper closes that gap.

## How the benchmark was built

The team assembled 15 representative methods spanning 7 methodological categories, covering both traditional approaches (model-based, smoothing-based, and low-rank matrix-based) and recent deep learning ones (diffusion, GAN, GNN, and autoencoder). Evaluation ran across 30 datasets (26 real and 4 simulated) sourced from 10 distinct protocols including 10x Chromium, SMART-seq2, CEL-seq2, Drop-seq, and Fluidigm C1.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [A Large-Scale Comparative Analysis of Imputation Methods for Single-Cell RNA Sequencing Data](https://arxiv.org/abs/2603.24626)
- [scGPT GitHub repository](https://github.com/bowang-lab/scGPT)
- [MAGIC project page - Krishnaswamy Lab](https://www.krishnaswamylab.org/projects/magic)
- [imputationBenchmark by Hou et al.](https://github.com/Winnie09/imputationBenchmark)