What if you could watch an AI think , not just read its outputs, but observe the silent, internal steps it takes before writing a single word? That is exactly what Anthropic's new interpretability research delivers. The team has identified a small, privileged set of internal representations inside Claude that function like a mental workspace: a place where the model silently reasons, notices things it never says out loud, and plans what to do next. They call it the J-space.

The problem: AI reasoning is mostly invisible

Current AI safety work has a fundamental blind spot. We can read what a model writes , its chain-of-thought, its final answer , but a large fraction of its reasoning happens silently, in the raw numerical activations of the network. A model could weigh a manipulative strategy, recognize it is being tested, or pursue a hidden goal, all without any of this appearing in its output. Monitoring outputs alone is like judging someone's intentions only by what they say aloud.

The broader field of mechanistic interpretability has been chipping away at this problem for years, but most tools either require expensive training (sparse autoencoders), are limited to shallow correlations (linear probes), or only work reliably in the final layers of the network (the logit lens). What was missing was a principled, cheap, causally grounded way to read the middle of the computation , where the interesting thinking actually happens.

The Jacobian lens: reading thoughts before they are spoken

The key insight behind the new technique is deceptively simple: if a thought is consciously accessible to a human, they can usually put it into words. The team went looking for the same property inside Claude , internal representations that are poised to be verbalized, even if they never actually are. The result is the Jacobian lens (J-lens), named after the mathematical operation at its core.

Here is how it works at a high level:

  1. For each layer of the model's residual stream, compute the average first-order effect (the Jacobian) of an activation on the model's output logits , averaged over 1,000 diverse prompts, not just a single context.
  2. This averaging step is crucial: it separates representations that are generally verbalizable from ones that just happen to be verbalized in one specific context.
  3. Applying this averaged Jacobian to any activation at any layer produces a ranked list of vocabulary tokens , the words the model is, at that moment, internally oriented toward.
  4. The collection of directions in activation space that correspond to these verbalizable tokens is the J-space.

Mathematically, the lens computes:

J_l = E[∂h_final / ∂h_l]  # averaged over token positions and 1000 prompts
lens(h_l) = softmax(W_U · norm(J_l · h_l))  # ranked token list

The result is a single precomputed matrix per layer. At inference time, reading the J-space costs just one matrix multiply per layer , cheap enough to run at scale.

What the J-space actually is

Alpha Signal

Don't miss what's next in AI

Join 300,000+ engineers and researchers who get the signal, not the noise.

  • Full access to in-depth AI research breakdowns
  • Be the first to know what's trending before it hits mainstream
  • Daily curated papers, repos, and industry moves