Runway's Aleph 2.0 Fills Missing Video Frames When You Change Aspect Ratios

Runway's Aleph 2.0 can now reformat any video for any aspect ratio, intelligently filling in the scene rather than just cropping it

·
·
·
  • Runway's Edit Studio now lets you reformat any video to any aspect ratio, with Aleph 2.0 filling in the new frame area intelligently.
  • Aleph 2.0 is an in-context video editing model that changes only what you ask, preserving lighting, motion, and continuity across the rest of the clip.
  • Supports clips up to 30 seconds at 1080p, with multi-shot propagation across up to 10 cuts in a single pass.
  • Available now on all paid Runway plans; costs 28 credits per second (840 credits for a 30-second edit).
  • Paid plans start at $12/month (Standard, 625 credits) and $28/month (Pro, 2,250 credits) billed annually.
  • Key limitation: multi-shot edits break when subjects change drastically between cuts; clips with more than 10 shot changes must be split manually.

Runway just pushed a new capability to its Edit Studio: upload a video, pick a new aspect ratio, and Aleph 2.0 fills in the missing parts of the scene as if it was always shot that way. No black bars, no awkward cropping, no reshoots. The model synthesizes new visual content to complete the frame.

One shoot, every feed

The core problem is familiar to anyone who has shipped video content across platforms. A 16:9 brand video looks terrible on TikTok. A vertical Instagram Reel gets letterboxed on YouTube. Until now, the options were either crop and lose content, or go back to the editing suite and manually extend the frame. Aleph lets you adapt existing footage for new contexts by changing aspect ratios, camera views, lighting, or visual tone to fit different platforms. Footage filmed horizontally can be reframed for mobile with a vertical crop and a new focal point.

Aleph supports multiple aspect ratios including 16:9, 4:3, 1:1, 3:4, and 9:16, so you can optimize output for any platform from widescreen YouTube to vertical TikTok content without awkward cropping or black bars. The model does not just crop. It generates the new portions of the scene to match the existing footage, preserving lighting, motion, and visual continuity.

What Aleph 2.0 actually is

Aleph 2.0 is Runway's upgraded flagship video editing model for transforming existing footage while keeping the rest of the clip stable. It is built for precise localized edits, single-frame visual guidance, and consistent edits across cuts and scene changes. Think of it as the opposite of a text-to-video generator. Instead of hallucinating a scene from scratch, it takes your real footage and surgically changes only what you ask.

The key technical concept here is in-context editing: the model reads the full visual context of your clip (lighting, motion, subject identity, color grade) and uses that to constrain what it generates. Unlike image-based editing applied frame-by-frame, Aleph maintains smooth, stable results across all frames. Objects that are added stay consistent. Removed elements do not flicker back. Style changes remain uniform throughout the clip.

The aspect ratio reformatting feature announced today is a direct application of this: the model reads the existing scene and fills in the new canvas area with plausible, consistent content rather than leaving it empty or guessing blindly.

The four things Aleph 2.0 does well

  • Localized edits: Describe what you want to change, a product color, a hairstyle, a piece of clothing, and Aleph 2.0 changes only that. The background, lighting, and other details stay just as they were.
  • Image-guided changes: Other AI video models leave the final look up to the model. With Aleph 2.0, your edited frame defines what the change should look like, and the model carries it through to the right parts of your video.
  • Multi-shot propagation: In videos with multiple cuts or scene changes, Aleph 2.0 will apply your edit across relevant shots. You no longer need to edit your videos shot-by-shot.
  • Longer clips: It supports clips up to 30 seconds at 1080p. That covers most ads, social posts, and short-form content.

Where it breaks down

Multi-shot propagation depends on the model recognizing the subject as continuous across cuts. Sharp identity jumps between shots, such as a different actor or a different product variant, can break the propagation and produce inconsistent edits per shot. If the shots in your reel are visually disjoint, edit them as separate clips and stitch afterwards.

There are also hard input constraints to be aware of. Uploaded videos must be longer than 2 seconds and shorter than 30 seconds, use a conventional aspect ratio, be between 480p and 1080p, run at 24 to 30 FPS, and contain no more than 10 cuts or shot changes. Anything outside those bounds gets rejected.

The real shift: editing, not generation

The broader significance here is strategic. Runway is defending its production-workflow position as AI video competition shifts from generation to controllable editing. AI video competition has become crowded fast. Google Veo, ByteDance Seedance, Kling, Pika, Luma, and Runway are all chasing the same creator and marketing budgets. Runway's answer is not just a better generator. It is a more complete post-production loop.

Marketers, agencies, and small businesses rarely need one impressive demo clip. They need campaign variants, product swaps, localization, aspect-ratio changes, seasonal edits, and fixes after the shoot. Aleph 2.0 is built exactly for that list. The aspect ratio feature announced today is one more item checked off.

Practical use cases

  • Reformat a 16:9 brand video to 9:16 for Instagram Reels or TikTok without losing the subject
  • Swap a product colorway across an entire ad without re-shooting
  • Change the background setting or time of day for a seasonal campaign variant
  • Remove a distracting element (a logo on a wall, a passerby) that was missed on set
  • Apply a consistent style regrading across a multi-shot reel in one pass

How to use it and what it costs

Aleph 2.0 in Edit Studio is available now on all paid Runway plans on the desktop web app. The Standard plan at $12/month annually includes generative video via Aleph, Gen-4.5, Gen-4, Act-Two, and Veo models, with 625 monthly credits. The Pro plan at $28/month annually includes 2,250 credits per month.

Credits are not free to burn with Aleph. Aleph 2.0 costs 28 credits per second with a 56-credit minimum. A 10-second edit costs 280 credits, and a full 30-second edit costs 840 credits. On the Standard plan, that means roughly two full 30-second edits per month before you run out. Plan accordingly.

The workflow in Edit Studio is straightforward: upload your clip, select the target aspect ratio, and let the model fill in the rest. You can preview your change as an image so you can shape the look before you commit to generating your final video. That image-first preview step is worth using, since it lets you catch bad outputs before spending credits on a full generation. Developers can also access Aleph 2.0 through the Runway API for programmatic workflows.

Trending
  • No trending articles

Comments

avatar

Next Reads