---
title: "Stanford's PersuasionTrace Catches AI Persuasion Mid-Conversation and Exposes Flawed Simulators"
subtitle: "PersuasionTrace tracks human belief changes turn-by-turn during LLM conversations, revealing that vanilla LLM simulators fail to replicate how real people update beliefs under persuasion"
url: "https://alphasignal.ai/news/stanford-s-persuasiontrace-catches-ai-persuasion-mid-conversation-and-exposes"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-06-03T00:00:00.000Z"
updated: "2026-06-11T03:31:54.107Z"
type: "Paper"
topics:
  - "Security"
  - "Post Training"
subtopics:
  - "Red Teaming"
  - "Alignment"
  - "Rlhf"
upvotes: 2068
source_url: "https://arxiv.org/abs/2606.05330"
comments: 0
truncated: true
---

# Stanford's PersuasionTrace Catches AI Persuasion Mid-Conversation and Exposes Flawed Simulators

> PersuasionTrace tracks human belief changes turn-by-turn during LLM conversations, revealing that vanilla LLM simulators fail to replicate how real people update beliefs under persuasion

We already know LLMs can persuade people. What we don't know is **how** it happens. A new paper from Stanford and the University of Washington introduces [PersuasionTrace](https://arxiv.org/abs/2606.05330), a framework that moves beyond the standard before-and-after belief measurement to capture the full trajectory of belief change during a multi-turn conversation with an AI persuader. The findings reveal that human belief dynamics are far messier and more heterogeneous than existing research suggests, and that the simulated human targets commonly used to test persuasion systems are deeply flawed.

## The problem with "did it work?"

Almost every LLM persuasion study to date measures a single number: how much did someone's belief shift from before the conversation to after? These endpoint measures identify whether persuasion occurred, yet miss where and how beliefs moved within a dialogue. In agentic LLM settings, where policies act over many steps, endpoint-only metrics can obscure whether a system is robust across turns or simply benefits from a few brittle moments of movement. The field has also relied heavily on simulated human targets, LLM agents prompted to play the role of a persuadable person. Given their flexibility, LLMs promise not only to persuade real people, but also to simulate human targets of persuasion, to model the mechanisms of belief change over a conversation. The problem, as this paper shows, is that they're bad at it.

The stakes are real. AI advice can shift beliefs durably even after the advisor is removed, and models with minimal demographic data are markedly more persuasive than humans in multi-round debates. Large-scale user experiments have confirmed that LLM-generated messages can shift beliefs to a degree comparable with, or even exceeding, human-written arguments. Understanding the mechanism, not just the outcome, matters enormously for both AI safety and the design of persuasive systems.

## What PersuasionTrace actually does

PersuasionTrace records both standard pre/post and turn-level belief reports during persuasive dialogues, implemented in a web-based platform used to analyze how LLM persuaders and human targets behave across turns. After each message from the LLM persuader, participants rate their belief in the proposition on a 0-100 scale, generating a full trajectory rather than a single delta. The platform also supports audio conversations and personalized propositions, where participants bring their own real-life decisions to debate.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [A Model of Multi-turn Human Persuadability Using Probabilistic Belief Tracing (arXiv)](https://arxiv.org/abs/2606.05330)
- [PersuasionTrace GitHub Repository](https://github.com/jlcmoore/persuasiontrace)
- [Can LLMs Persuade Humans with Deception? (CHI 2026)](https://dl.acm.org/doi/10.1145/3772318.3791188)
- [LLM-generated messages can persuade humans on policy issues (Nature Communications)](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12215518/)
- [The Hidden Puppet Master: Predicting Human Belief Change in Manipulative LLM Dialogues (arXiv)](https://arxiv.org/html/2603.20907v2)