---
title: "Researchers Catch LLMs Looping Into the Same Sentences After 50 Rewrites"
subtitle: "A new paper models repeated LLM rephrasing and translation as Markov chains, revealing when outputs collapse into loops versus keep drifting."
url: "https://alphasignal.ai/news/researchers-catch-llms-looping-into-the-same-sentences-after-50-rewrites"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-10-26T12:00:45.812Z"
updated: "2026-11-05T17:01:04.959Z"
type: "Paper"
topics:
  - "Llms"
  - "Reasoning"
subtopics:
  - "Hallucinations"
  - "Long Context"
upvotes: 3698
source_url: "https://arxiv.org/abs/2603.11228"
comments: 0
truncated: true
---

# Researchers Catch LLMs Looping Into the Same Sentences After 50 Rewrites

> A new paper models repeated LLM rephrasing and translation as Markov chains, revealing when outputs collapse into loops versus keep drifting.

Repeatedly feeding an LLM’s output back into the same prompt can produce either a short cycle or dozens of new sentences, depending largely on the decoding method. An EMNLP 2026 Findings [paper](https://arxiv.org/abs/2603.11228) formalizes this workflow as a Markovian generation chain and measures how quickly repeated paraphrasing and translation begin to recur.

Each run is deliberately memoryless: the model receives a fixed prompt template and the previous output, without chat history. The resulting process forms a time-homogeneous Markov kernel over sentence strings, meaning the next output depends only on the current sentence and a transition rule that stays fixed across iterations.

## Why Repeated Inference Needs Its Own Model

Model collapse describes a training-time effect in which repeated use of synthetic data narrows the learned distribution. The behavior studied here occurs during inference, while model parameters remain fixed. Some inputs even gain sentence diversity over successive calls, so training-data collapse does not adequately describe the observed dynamics.

Markov-chain concepts give developers a more precise vocabulary for these pipelines. Transient states are outputs the process leaves behind, recurrent classes are sets of outputs it revisits, and KL contraction measures whether different output distributions become more alike after applying the same transition. These concepts help characterize repeated calls in agent systems, rewriting tools, and translation workflows.

## Inside the 50-Step Test

The authors begin with 150 opening sentences drawn from BookSum, ScriptBase-alpha, and BBC News2024\. Each sentence passes through 50 rounds of paraphrasing or round-trip translation under the following configurations:

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [Markovian Generation Chains in Large Language Models](https://arxiv.org/abs/2603.11228)
- [Markovian Generation Chains in Large Language Models (HTML)](https://arxiv.org/html/2603.11228)
- [LLM as a Broken Telephone: Iterative Generation Distorts Information](https://aclanthology.org/2025.acl-long.370/)
