---
title: "CANVAS Fixes AI Storyboards by Tracking Story Worlds Across Shots"
subtitle: "A training-free multi-agent system that tracks characters, locations, and object states across shots lifts background continuity by 21.6 percent."
url: "https://alphasignal.ai/news/canvas-fixes-ai-storyboards-by-tracking-story-worlds-across-shots"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-04-15T00:00:00.000Z"
updated: "2026-08-23T22:12:40.707Z"
type: "Paper"
topics:
  - "Video"
  - "Agents"
subtopics:
  - "Video Generation"
  - "Multi Agent"
  - "Computer Use"
upvotes: 1547
source_url: "https://arxiv.org/abs/2604.13452"
comments: 0
truncated: true
---

# CANVAS Fixes AI Storyboards by Tracking Story Worlds Across Shots

> A training-free multi-agent system that tracks characters, locations, and object states across shots lifts background continuity by 21.6 percent.

Image generators can nail a single stunning frame, but string ten of them together into a story and things fall apart. The hero's jacket changes color, the coffee shop rearranges itself, and a stolen artifact reappears in its display case two shots later. A new framework called [CANVAS](https://arxiv.org/abs/2604.13452) tackles this by treating storyboard generation as an explicit world-state tracking problem rather than a sequence of isolated image generations.

The approach is training-free, wraps around existing image models, and improves background continuity by 21.6%, character consistency by 9.6%, and prop consistency by 7.6% over the strongest prior baseline.

## Why storyboards break

Most story visualization systems generate each frame more or less independently, sometimes with short-range conditioning on the previous image. These methods enforce short-range consistency and do not explicitly model the evolving narrative world. Inconsistencies accumulate over time, producing familiar failure modes: character appearance drifts, environments shift when locations reappear, and objects end up in the wrong state after narrative events. The story world itself is never explicitly represented.

Think of the difference between an artist sketching each panel from scratch versus one who keeps a reference sheet pinned to the wall. In a coherent narrative, characters keep their identity unless the plot changes them, revisited rooms preserve their spatial layout, and objects follow causal state changes (a vase is intact, then broken, then swept away).

![Comparison of AutoStudio, Gemini, and CANVAS outputs against reference shots showing inconsistencies in character appearance, props, and backgrounds](https://arxiv.org/html/2604.13452v1/Teaser_Figure_CANVAS_Final.png) 

## Storyboarding as world-state tracking

CANVAS reframes the problem by formulating storyboard generation as explicit world-state modeling, maintaining structured representations of characters, locations, and object states as the narrative evolves. The multi-agent framework enforces continuity through world-state transitions via iterative planning, generation, and memory updates.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [CANVAS: Continuity-Aware Narratives via Visual Agentic Storyboarding](https://arxiv.org/abs/2604.13452)
- [CANVAS full paper (HTML)](https://arxiv.org/html/2604.13452v1)
- [ViStoryBench: Comprehensive Benchmark Suite for Story Visualization](https://arxiv.org/abs/2505.24862)
- [ViStoryBench Leaderboard](https://vistorybench.github.io/)