Stanford's SAT Framework Teaches AI Teams to Outsmart Any Solo Model

Stanford and Together AI show fixed teams of LLMs can learn reusable collaboration protocols that beat any single member and even a perfect answer router.

·
·
·
Stanford's SAT Framework Teaches AI Teams to Outsmart Any Solo ModelPRO
  • SAT lets fixed LLM teams learn reusable conversation strategies from as few as 15-25 training problems.
  • Math-and-physics team averages 66.7% across five benchmarks, versus 48.8% for its best member.
  • On AIME 2026, the team beats a perfect answer-routing oracle by 13.4 points.
  • Learned strategies transfer unchanged from AIME 2024 to HMMT, TheoremQA-physics, MMLU-Pro, and BBEH.
  • Demonstrability, whether correct reasoning is recognizable, predicts gains with Spearman ρ=0.90.
  • Full preprint includes deployed strategy banks and transcripts of cross-member repair.

Researchers at Stanford and Together AI have introduced Self-Organizing Agent Teams (SAT), a method for teaching a fixed roster of large language models reusable collaboration strategies. The teams learn from 15 to 25 scored problems, freeze their strategies, and apply them unchanged to new benchmarks. In the reported experiments, those conversations sometimes produced correct answers that no model had reached independently.

Why fixed workflows stall

Common multi-agent systems prescribe the collaboration pattern before seeing the task. That approach works when the designer already knows how information should move, but it can fail when the useful division of reasoning emerges only during the discussion.

  • Debate repeatedly exposes agents to competing answers. Much of its measured gain may come from selecting a strong initial answer, while later rounds can suppress a correct minority view.
  • Mixture of Agents passes proposals through a one-way pipeline to a synthesizing model.
  • Workflow search routes predefined subtasks through a generated process, which assumes that the task decomposes cleanly.

SAT addresses cases where each model holds only part of the solution and the appropriate reasoning structure remains unknown. It searches for conversation patterns that let agents propose, challenge, repair, and verify one another’s work.

Teamwork becomes a small program

SAT represents each collaboration strategy in a compact domain-specific language. The representation controls who participates, what each model sees, how long discussion continues, and how the team reaches a final answer.

Component What it controls
Teamwork prompt The shared objective and collaboration rules.
Role prompts Persistent responsibilities for individual agents, such as proposing, challenging, or auditing.

Pro article

This story is for Pro members

You've reached the end of the free preview. Upgrade to AlphaSignal Pro to read the full article - and everything else behind the paywall.

Trending
  • No trending articles

Comments

avatar

Next Reads