---
title: "GOTabPFN Unlocks Biomedical AI for Datasets With 20,000 Features and 100 Samples"
subtitle: "GOTabPFN uses graph-based feature ordering and neural compression to squeeze high-dimensional biomedical data into TabPFN's token budget without retraining the model."
url: "https://alphasignal.ai/news/gotabpfn-unlocks-biomedical-ai-for-datasets-with-20-000-features-and-100-samples"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-06-03T00:00:00.000Z"
updated: "2026-06-11T07:06:05.489Z"
type: "Paper"
topics:
  - "Llms"
  - "Data"
subtopics:
  - "Structured Output"
  - "Small Models"
upvotes: 1564
source_url: "https://arxiv.org/abs/2606.05441"
comments: 0
truncated: true
---

# GOTabPFN Unlocks Biomedical AI for Datasets With 20,000 Features and 100 Samples

> GOTabPFN uses graph-based feature ordering and neural compression to squeeze high-dimensional biomedical data into TabPFN's token budget without retraining the model.

[GOTabPFN](https://arxiv.org/abs/2606.05441) is a new wrapper around TabPFN, the popular tabular foundation model, that finally makes it practical for the kind of data that shows up most often in biology and medicine: datasets with thousands of features and only a handful of samples. The paper introduces two key ideas -- a graph-guided feature ordering algorithm and a neural compression unit -- that together compress wide, sparse tables into the compact token representations TabPFN was designed to consume.

## The wall TabPFN hits in the real world

TabPFN is a prior-fitted network designed for tabular data that approximates Bayesian inference via in-context learning. Unlike traditional models, it does not require any additional training when presented with a new dataset -- it directly takes a set of labeled training samples along with test samples and produces predictions in a single forward pass. That zero-retraining property is what makes it so appealing.

But there is a hard constraint baked into the architecture. Attention that is both row-wise and feature-wise dense introduces unfavorable scaling with table width, as the computational cost is quadratic with respect to the number of samples and the number of features. In practice, this means TabPFN has a strict token budget. TabPFN v2 significantly outperforms tree-based and neural network competitors on small-to-medium datasets with up to 10K samples and 500 features. Go beyond those limits and performance degrades fast.

This matters enormously for a class of problems called **HDLSS** \-- High-Dimensional, Low-Sample Size. HDLSS data presents unique challenges in statistical modeling and machine learning, particularly in fields such as healthcare and genomics. The number of features, or variables, far exceeds the number of available samples or observations, making traditional statistical techniques less effective and often leading to overfitting and poor generalizability. A classic example: a study might involve expression levels of 20,000 genes across only 100 patients. TabPFN, as designed, simply cannot handle that ratio.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [GOTabPFN: From Feature Ordering to Compact Tokenization for Tabular Foundation Models on High-Dimensional Data](https://arxiv.org/abs/2606.05441)
- [A Closer Look at TabPFN v2: Strength, Limitation, and Extension](https://arxiv.org/html/2502.17361v1)
- [GitHub - PriorLabs/TabPFN](https://github.com/PriorLabs/tabpfn)
- [Noise Immunity in In-Context Tabular Learning: An Empirical Robustness Analysis of TabPFN's Attention Mechanisms](https://arxiv.org/pdf/2604.04868)
- [Multitask-Informed Prior for In-Context Learning on Tabular Data](https://arxiv.org/pdf/2603.22738)