NVIDIA's SoL-Pi Slashes Coding Agent Token Use by 49%

NVIDIA Labs released SoL-Pi, a coding agent extension that cuts token cost by roughly one-third using four mechanisms discovered by auto-research loops.

·
·
NVIDIA's SoL-Pi Slashes Coding Agent Token Use by 49%PRO
Read2 min
TypeRepo
  • NVIDIA Labs released SoL-Pi, an MIT-licensed extension for the Pi coding agent focused on token efficiency.
  • Four mechanisms: Action Fusion, ObservationPack, Evidence-Preserving Reducer, Online Context Compact, all opt-in.
  • On EdgeBench, uses 45-49% fewer tokens and about one-third lower cost than Pi while keeping ~94% of task score.
  • Discovered through auto-research loops that filtered 152 proposed ideas down to 4 surviving mechanisms.
  • Built and validated across 535 executable environments derived from GitHub issue-PR pairs and synthetic verifier tasks.
  • Full methodology and results published on the SoL-Pi research blog.

NVIDIA’s SoL-Pi cuts token use in long coding-agent runs

NVIDIA researchers have released SoL-Pi, an open-source extension for the Pi coding-agent harness that reduces repeated work during long tasks. Its four opt-in mechanisms combine predictable actions, replace replayed output with handles, condense verified evidence, and compact completed context. The team selected those mechanisms through a scaled auto-research pipeline in which agents proposed, implemented, tested, and reviewed harness changes.

A coding-agent harness coordinates the model, conversation history, editing tools, shell commands, and returned observations. As a task stretches across hours, the harness may repeatedly send old context, ingest large tool outputs, write caches, and request extra model turns. Those costs accumulate even when the underlying model and task remain unchanged.

NVIDIA connects this efficiency problem to recursive self-improvement, or RSI, in which AI systems help modify the software and workflows used to develop subsequent AI systems. SoL-Pi tests whether AI-assisted harness research can make those loops cheaper while maintaining a declared capability floor.

Four controls for recurring waste

SoL-Pi installs through npm and runs on an unmodified release of Pi. The extension leaves every mechanism disabled until the developer enables it in configuration, allowing teams to evaluate each change separately.

  • Action Fusion lets a file edit or write invoke its follow-up validation command in the same tool call. Analysis of prior trajectories found that edit or write transitions followed by commands represented 12.3% of cross-turn transitions, with Bash accounting for 85.1% of those next actions.
  • ObservationPack replaces repeated large text results with stable handles and exact paged recall. It archives the original payload locally, allowing the agent to retrieve specific pages without replaying the entire result.
  • Evidence-Preserving Reducer converts long diagnostic logs into compact sets of verbatim evidence. A cheaper model reads the full log first, and every retained quotation must match the archived source before the primary model receives it.

Pro article

This story is for Pro members

You've reached the end of the free preview. Upgrade to AlphaSignal Pro to read the full article - and everything else behind the paywall.

Comments

avatar