UT Austin Finds Fractal Chaos Explains Why AI Reasoning Costs Spike 10x
A new paper shows recurrent-depth reasoning models behave like chaotic dynamical systems, where hard problems create fractal basins that trap thinking near wrong answers.
PRO- UT Austin researchers show recurrent reasoning models form fractal basins when solving hard problems.
- Fractality increases with task difficulty across Sudoku, mazes, Countdown, and ARC-AGI-1.
- Transient chaos comes from saddle points that encode nearly-correct wrong answers.
- Fast Lyapunov Indicator predicts how many candidate solutions a model visits before converging.
- Training a loop transformer showed fractals emerge at the same moment generalization does.
- Basin probing code released as GilpinLab/loopscape on GitHub.
A team from UT Austin has borrowed tools from nonlinear physics to explain something practitioners keep noticing but nobody could pin down: why two nearly identical prompts can produce reasoning traces that differ by ten times in length and token cost. Their answer is that recurrent-depth reasoning models are dynamical systems with fractal basins of attraction, and harder problems make the fractality worse.
The setup treats reasoning as an optimizer. A reasoning model and problem instance jointly define an autonomous discrete-time dynamical system acting on a latent state, and the latent state after each loop can be decoded as an intermediate solution representation. The final answer is a fixed point that trajectories converge to. What the authors probe is how the starting point of that trajectory affects convergence time.
Coloring the map of thought
Pick a model and a problem. The latent state for modern reasoning models is typically initialized by sampling a random vector. The authors continuously vary the initial latent state across a random 2D slice, then color each pixel by how many loops it took to reach the answer.
The maps look like Mandelbrot sets. Adjacent starting points take wildly different routes and iteration counts to reach the same correct answer. This is the physical signature of
This story is for Pro members
You've reached the end of the free preview. Upgrade to AlphaSignal Pro to read the full article - and everything else behind the paywall.
Comments
