NVIDIA's LongLive-2.0 Generates 64-Second 720p Video Using 6x Less Memory

Long video generation has a dirty secret: the algorithmic breakthroughs get the headlines, but the real bottleneck is infrastructure. Memory explodes, training stalls, and inference pipelines buckle under the weight of minute-long sequences. NVIDIA Research's LongLive-2.0 takes direct aim at this, treating the entire stack -- training, distillation, and inference -- as a single system built around NVFP4, NVIDIA's 4-bit floating-point format.

The Problem Nobody Talks About

Most video generation systems are trained in high precision (BF16, which stores each number in 16 bits) and then quantized down to lower precision at deployment time. Quantization compresses model weights by reducing the number of bits used to represent each number: BF16 stores each number in 16 bits, while NVFP4 compresses them to 4 bits, so the model uses less memory and runs faster. The catch is that this post-training quantization creates a gap -- the model was never optimized for the precision it actually runs at, and quality degrades as a result.

LongLive-2.0 presents an NVFP4-based parallel infrastructure throughout the full training and inference workflow of long video generation, addressing speed and memory bottlenecks. The key insight is that if you design for NVFP4 from the very first training step, you close that gap entirely. In theory this should reduce generation quality, but the authors show that in practice results are nearly identical to BF16.

There is also a second, less obvious problem. Instead of focusing purely on algorithmic novelty, the paper presents a systems-level approach to tackle the speed and memory bottlenecks in long video generation. For a 64-second video, the memory and compute requirements don't grow linearly -- they compound. Plain BF16 is efficient only at shorter video lengths, taking 75.3s and 202.7s at 16s and 32s, but running out of memory entirely at 64s.

How It's Built

LongLive-2.0 treats algorithm and infrastructure as one system. On the training side, Balanced SP and NVFP4 make long-video AR fine-tuning practical. On the inference side, W4A4 execution, NVFP4 KV cache, parallel dequantization, and asynchronous VAE decoding improve end-to-end throughput.