---
title: "Dream-RSI Cuts AI Coding Agent Calls by 162x Using Replay Worlds"
subtitle: "A new preprint reframes recursive self-improvement as dreaming inside a replay simulator built from an agent's own discovery history."
url: "https://alphasignal.ai/news/dream-rsi-cuts-ai-coding-agent-calls-by-162x-using-replay-worlds"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-09-18T01:23:20.899Z"
updated: "2026-09-22T03:47:17.428Z"
type: "Repo"
topics:
  - "Agents"
  - "Open Source"
subtopics:
  - "Code Agents"
  - "Deep Research"
  - "Multi Agent"
upvotes: 1710
source_url: "https://github.com/zhengkid/Dream-RSI"
comments: 0
truncated: true
---

# Dream-RSI Cuts AI Coding Agent Calls by 162x Using Replay Worlds

> A new preprint reframes recursive self-improvement as dreaming inside a replay simulator built from an agent's own discovery history.

# Dream-RSI replays coding-agent histories to tune exploration

Researchers at the University of Maryland, the University of Virginia, Google, and Google DeepMind have released the [Dream-RSI preprint](https://github.com/zhengkid/Dream-RSI), short for Recursive Self-Improvement through Evolving Worlds. Lead author Tong Zheng hosts the PDF through a personal GitHub repository. A [project page](https://www.dream-rsi.com) is also live, while the codebase, discovered programs, and reproduction scripts remain unavailable.

## Why the outer loop gets expensive

Self-improving coding systems often use an outer policy to control how an agent explores candidate programs. That policy chooses which branches to pursue, how many workers to run, and when to stop. Comparing policies usually requires fresh agent calls and code executions across thousands of iterations, so weak exploration strategies can consume substantial compute before producing useful results.

Dream-RSI reduces that evaluation cost by reusing completed discovery runs. The method targets the exploration policy around the coding agent rather than retraining the underlying model.

## Turn traces into replay worlds

Each completed run produces a structured tree containing exploration decisions, generated programs, and execution results. Dream-RSI compiles those trees into replay simulators. Candidate policies can traverse recorded branches in different orders, select different subsets, alter parallel groupings, and test stopping rules while retrieving cached outcomes.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [zhengkid/Dream-RSI GitHub repository](https://github.com/zhengkid/Dream-RSI)
- [Dream-RSI project page](https://www.dream-rsi.com)
- [Dream-RSI paper (PDF)](https://github.com/zhengkid/Dream-RSI/blob/main/papers/Dream-RSI.pdf)