---
title: "NVIDIA's ViPE Turns Ordinary Video Into 3D Geometry With 96M Annotated Frames"
subtitle: "NVIDIA released ViPE, an open-source engine that recovers camera intrinsics, motion, and metric depth from any raw video, plus 96M annotated frames."
url: "https://alphasignal.ai/news/nvidia-s-vipe-turns-ordinary-video-into-3d-geometry-with-96m-annotated-frames"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-04-15T19:09:28.000Z"
updated: "2026-08-23T01:08:40.010Z"
type: "Repo"
topics:
  - "Open Source"
  - "Robotics"
subtopics:
  - "Vla Models"
upvotes: 11
source_url: "https://github.com/nv-tlabs/vipe"
comments: 0
truncated: true
---

# NVIDIA's ViPE Turns Ordinary Video Into 3D Geometry With 96M Annotated Frames

> NVIDIA released ViPE, an open-source engine that recovers camera intrinsics, motion, and metric depth from any raw video, plus 96M annotated frames.

NVIDIA's Toronto AI Lab has released [ViPE](https://github.com/nv-tlabs/vipe), a video processing engine that pulls calibrated 3D geometry out of ordinary video clips. Point it at a selfie, a dashcam recording, a cinematic pan, or a 360-degree panorama, and it returns per-frame camera intrinsics, camera pose, and dense near-metric depth maps. It ships under Apache 2.0, installs from PyPI as `nvidia-vipe`, and comes with a companion dataset of roughly 96 million annotated frames.

## The messy problem it cleans up

Training spatial AI, world models, and 4D reconstruction systems requires video labeled with accurate camera trajectories and depth. Getting consistent, precise 3D annotations from in-the-wild footage remains a stubborn problem, and existing pipelines break the moment a scene contains moving objects, an unknown lens, or a fisheye field of view. Classical structure-from-motion tools assume static scenes and calibrated cameras. Recent learned methods either struggle with scale drift or fall over on long, dynamic clips.

ViPE estimates camera intrinsics, camera motion, and dense near-metric depth from unconstrained raw video, and handles dynamic selfies, cinematic shots, and dashcams across pinhole, wide-angle, and 360-degree panorama models. That last part matters, because most existing pose estimators quietly assume a pinhole camera.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [nv-tlabs/vipe on GitHub](https://github.com/nv-tlabs/vipe)
- [ViPE: Video Pose Engine for 3D Geometric Perception - NVIDIA Research](https://research.nvidia.com/labs/toronto-ai/vipe)
- [ViPE Technical Report on arXiv](https://arxiv.org/abs/2508.10934)
- [nvidia-vipe on PyPI](https://pypi.org/project/nvidia-vipe/)