---
title: "AI Safety Circuits Found in One Model Don't Transfer to Others"
subtitle: "A new cross-architecture study shows that the same task is solved by completely different internal circuits across Pythia, OLMo, and OLMoE -- breaking a core assumption of mechanistic interpretability"
url: "https://alphasignal.ai/news/ai-safety-circuits-found-in-one-model-don-t-transfer-to-others"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-06-03T00:00:00.000Z"
updated: "2026-06-11T03:39:58.378Z"
type: "Paper"
topics:
  - "Llms"
  - "Reasoning"
subtopics:
  - "Hallucinations"
  - "Mixture Of Experts"
  - "Test Time Compute"
upvotes: 850
source_url: "https://arxiv.org/abs/2606.05378"
comments: 0
truncated: true
---

# AI Safety Circuits Found in One Model Don't Transfer to Others

> A new cross-architecture study shows that the same task is solved by completely different internal circuits across Pythia, OLMo, and OLMoE -- breaking a core assumption of mechanistic interpretability

One of the most quietly consequential assumptions in AI interpretability research is that if you find the circuit responsible for a task in one model, you have found something universal -- a glimpse into how language models in general solve that problem. A new paper from Yongzhong Xu challenges that assumption head-on, and the results are uncomfortable for anyone building safety or auditing tools on top of circuit-level findings.

The [paper](https://arxiv.org/abs/2606.05378) tests a standard "screen-and-ablate" recipe -- identify which attention heads are selective for a task's pattern, then confirm causality by ablating those heads and measuring the performance drop -- across three 1B-class models and four tasks. The conclusion: **the method is portable, but the circuits it finds are not.**

## Why this matters to the field

Mechanistic interpretability is the branch of AI research that tries to reverse-engineer what specific components inside a neural network are actually doing. The flagship example is the **Indirect Object Identification (IOI)** circuit, first described in GPT-2 small: a set of name-mover heads, S-Inhibition heads, and induction heads that together let the model complete sentences like "When Mary and John went to the store, John gave the bag to \_\_\_" with "Mary."

The classical demonstration identified an attention-head circuit for IOI in GPT-2 small: name-mover heads at late layers, S-Inhibition heads suppressing the subject, prev-token and induction heads in middle layers, and duplicate-token and negative name-mover heads as auxiliary components. That decomposition became canonical -- a template that researchers assumed would generalize.

In mechanistic interpretability, the universality hypothesis asserts that neural networks with different architectures and scales form common internal representations. Strong evidence for or against this hypothesis could significantly affect research priorities: if common representations form across different language models and tasks, then research on small or toy models may be the best way to gain insights into LLM capabilities. This paper is a direct empirical test of that bet.

## The experiment: 12 cells, zero matches

Across four composed tasks -- indirect-object identification, greater-than, successor sequences, and variable binding -- and three 1B-class language models from distinct training pipelines (Pythia 1B trained on the Pile, OLMo 1B trained on DCLM, and OLMoE 1B-7B also on DCLM), the authors ran a unified protocol with the matched-random null sampled across ten seeds per cell.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [Pattern Selectivity is Not Task-Causal Structure (arXiv)](https://arxiv.org/abs/2606.05378)
- [Pattern Selectivity paper HTML (arXiv)](https://arxiv.org/html/2606.05378)
- [Quantifying LLM Attention-Head Stability: Implications for Circuit Universality](https://arxiv.org/html/2602.16740)
- [Mechanistic Analysis of Universality: Numerical Comparison Circuits Across Transformer Architectures](https://openreview.net/forum?id=79igg0kRtd)
- [A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models](https://arxiv.org/pdf/2407.02646)