Ai2 and Hugging Face Expand Partnership, Unlocking 2 Petabytes for Open AI

Ai2 triples its Hugging Face storage to ~2 petabytes and drops rate limits, cementing its position as the Hub's most prolific open-science publisher

ByAi2Ai2
·
·
AuthorAi2
Read1 min
  • Storage tripled: Hugging Face is expanding Ai2's Hub storage to ~2 petabytes and removing standard rate limits on downloads.
  • Scale of presence: Ai2 has 968+ models and 1,275+ datasets on the Hub, with 50M+ downloads since spring 2024 -- more annual artifacts than any other tracked org.
  • MolmoAct 2 integration: Ai2's open robotics model is now native to LeRobot, downloaded 400K+ times in weeks, with a 37x inference speedup over v1.
  • 720 hours of robot data: MolmoAct 2 ships with the largest open-source bimanual manipulation dataset ever published, while competitors keep data closed.
  • Benchmarks go official: olmOCR-Bench is now an official Hub leaderboard; RewardBench 2, IFBench, and AstaBench also live on the Hub.
  • What's next: Ai2 previews forthcoming multimodal models, tool-using agents, and science-domain models -- all backed by a $152M NSF/NVIDIA compute project.

The Allen Institute for AI (Ai2) and Hugging Face have expanded their partnership well beyond a storage upgrade. Ai2 is the most prolific publisher of open AI artifacts on the Hub, and Hugging Face is backing that output with infrastructure to match.

What changed, concretely

The terms are effective immediately. Hugging Face is roughly tripling Ai2's storage on the Hub to nearly two petabytes, and Ai2's traffic will no longer be subject to the Hub's standard rate limits. That means even its largest datasets and multi-checkpoint models can download at full throughput. Rate limiting has historically been a real friction point for teams trying to pull down large model checkpoints or multi-hundred-gigabyte datasets, particularly for groups without major cloud infrastructure behind them.

Since spring 2024, Ai2's models and datasets have been downloaded more than 50 million times from the Hub. That number explains why the upgrade was necessary: Ai2 was outgrowing the default tier.

The most prolific publisher on the Hub

According to Hugging Face's own model release heatmap, Ai2 publishes more new artifacts annually than any other organization it tracks, ahead of commercial labs with far larger headcounts and compute budgets. Ai2's

Keep reading

Don't miss what's next in AI

Join 300,000+ engineers and researchers who get the signal, not the noise. Create a free account to read the rest of this story.

  • Full access to in-depth AI research breakdowns
  • Be the first to know what's trending before it hits mainstream
  • Daily curated papers, repos, and industry moves