Runway brings video pretraining to robot control with Praxis-1

Runway is applying its video-generation research to physical robots. The company announced Praxis-1, its first open-weight world action model, built on the large-scale video pretraining used for its general world models. Early partners are testing the model on their hardware. Runway says the weights will arrive in the coming months, although it has not provided a release date.

Praxis-1 addresses one of robotics’ persistent constraints: collecting demonstrations through teleoperation is slow and expensive. Runway proposes using web video to teach a model about motion, object interactions, and physical plausibility before fine-tuning it on robot-specific data. The approach could reduce the volume of demonstrations required for each task and hardware configuration.

Web video targets the data bottleneck

General-purpose robot policies need examples covering different objects, environments, viewpoints, and failures. Teleoperation can capture those examples with action labels, but collecting enough data for rare conditions becomes costly. Web video offers broader visual coverage, even though it usually lacks the commands, joint positions, and force measurements recorded by robots.

Runway reports that performance improves as it increases third-person video pretraining. In one placement experiment, web-video pretraining and teleoperated robot-video pretraining produced nearly identical final errors after fine-tuning:

The 0.1 cm difference indicates parity within this reported experiment. Broader conclusions require task definitions, dataset sizes, variance across runs, and results from independent evaluators. Those details are absent from the announcement.

One model predicts and acts

A world model predicts how a scene may change over time, sometimes in response to an action. A policy model maps observations from cameras and sensors to commands a robot can execute. A world action model combines those functions, using learned representations of physical behavior to select actions.

Praxis-1 builds on Runway’s interactive video systems, including Solaris and GWM Worlds 2. Those systems generate controllable scenes intended to preserve physical relationships between objects, movement, and the surrounding environment.

Action-free video still leaves a grounding problem. Pixels can show a hand lifting a cup, but they do not provide the joint angles, gripper force, or control frequency required to reproduce the motion. Praxis-1 therefore needs robot-specific fine-tuning to connect visual concepts with executable commands. Runway has not disclosed how that grounding works or how much labeled robot data it requires.

Runway also reports a 0.95 correlation between policy evaluations performed inside its generated simulations and results on physical robots. A reliable relationship could let developers train and screen policies without repeatedly occupying a physical rig. The reported correlation does not establish absolute accuracy, calibration on rare failures, or safety under distribution shifts.

Four stubborn manipulation problems

Runway organizes the model’s target failure modes into four categories commonly associated with imitation-learning systems:

Runway’s hypothesis is that broad video pretraining supplies useful priors about refraction, folding, object boundaries, and plausible motion. Demonstration-only policies may encounter too few examples to learn those properties reliably. The announcement does not include per-category success rates or comparisons with public baselines.

Partners test the first builds

Runway is distributing Praxis-1 to selected partners before releasing the weights. The initial deployments cover several embodiments, meaning different combinations of robot bodies, arms, sensors, and control systems.

Runway also demonstrates the same policy operating in a controlled studio and a domestic kitchen without additional training. That test targets cross-environment transfer, which often requires site-specific fine-tuning or extensive domain randomization. The partner runs remain early product tests, with no independent benchmark results available.

Open weights, unresolved license

Runway says Praxis-1 will ship with downloadable model weights. Open-weight access lets developers inspect, fine-tune, and host model parameters under the eventual license. It does not define access to training code, datasets, architecture details, or unrestricted commercial use.

A permissive release could give robotics teams a general-purpose starting point for adapting policies to specific arms and mobile platforms. Teams would still need calibration data, task demonstrations, safety testing, and an integration layer for their sensors and controllers. Runway also presents open world models as part of its strategy for supporting United States development in physical AI.

What developers still need

Runway’s current announcement leaves several implementation and evaluation questions unanswered:

• Model size, architecture, checkpoint format, and numerical precision
• Inference hardware, latency, memory use, and supported control rates
• Observation formats, action representations, and sensor requirements
• The composition and provenance of the video pretraining corpus
• The method used to ground action-free video in robot commands
• The amount of robot data required for fine-tuning a new embodiment
• Supported arms, grippers, mobile bases, and calibration procedures
• Benchmark comparisons with Pi-0, RT-2, Octo, and other public policies
• Safety constraints, failure detection, and recovery behavior
• License terms, commercial rights, and a specific release date

Release and replication come next

Praxis-1 presents a testable claim that large-scale video pretraining can reduce robotics’ dependence on teleoperated demonstrations. The reported placement result supports that direction within one experiment, while the missing paper, weights, and benchmark details prevent reproducible comparison.

Robot data will remain necessary for action grounding, hardware adaptation, evaluation, and safety. If independent tests confirm Runway’s scaling results, teams may be able to use broad video pretraining to reduce the amount of teleoperation required for each deployment. Developers can request early access from Runway’s robotics team.