Automating scientific research has been a long-standing goal, but most attempts have stumbled on a quiet, structural problem: the systems produce papers that look right but can't be trusted. Citations are fabricated, reported scores don't reproduce, and the code doesn't match the method section. Google Cloud AI Research is presenting ScientistOne at ICML 2026 this week, a new end-to-end autonomous research system built around a single, unusual design principle: every claim must be traceable back to evidence.

The problem nobody was measuring

Autonomous research agents produce competitive solutions and professional-looking manuscripts, yet their outputs can contain verifiability failures undetectable by evaluations that only assess surface presentation rather than evidence grounding: fabricated citations, unreproducible scores, and method descriptions that diverge from the implementation. These failures share a common root: no existing evaluation protocol audits whether claims are supported, and no existing autonomous research system is designed to trace claims back to evidence.

To quantify this, the team ran a systematic audit across 75 papers from five leading autonomous research systems, all evaluated on the same five real-world computer systems tasks. The results were stark: hallucinated reference rates reach 21%, score verification passes in as few as 42% of papers, and method-code alignment ranges from 20% to 80%. Every single baseline system had at least one systematic failure mode.

Chain-of-Evidence: a new standard

The core innovation in ScientistOne is a framework called Chain-of-Evidence (CoE) , think of it as ACID guarantees for research claims. Just as a database transaction must be atomic and consistent, every claim in a CoE-compliant paper must trace through a recorded evidence chain to a grounding source. The framework defines four claim types that need to be verified:

  • Citation claims , the cited paper must actually exist and say what you claim it says
Alpha Signal

Don't miss what's next in AI

Join 300,000+ engineers and researchers who get the signal, not the noise.

  • Full access to in-depth AI research breakdowns
  • Be the first to know what's trending before it hits mainstream
  • Daily curated papers, repos, and industry moves