Nvidia researchers unveil SoL-Pi, a system that automatically optimizes coding-agent harnesses to cut token usage by up to 49% with minimal performance loss

Nvidia researchers published a paper on SoL-Pi, a system that uses a research AI agent to automatically rewrite the "harness" (the control layer for tool use, context and verification) around coding agents, keeping only changes that cut token usage without hurting performance. Across 535 test environments, its best efficiency configuration cut token usage by 49% on EdgeBench while retaining 93.7% of the baseline harness's score; a performance-tuned variant beat the baseline score by 5.3% while still saving tokens. Results were weaker and more mixed on other benchmarks, including Terminal-Bench 4, IMO 2026 Lean 4 tasks and kernel optimization swarms.

This is a research paper, not a released product, so nobody can adopt SoL-Pi today. If the approach holds up, it points to a second lever for cutting AI agent costs beyond swapping to cheaper models: optimizing the harness itself, which Nvidia estimates could save several dollars per hour versus running Codex, Claude Code or a baseline harness at current API prices. That would matter most to enterprises and developers running agents unsupervised for long stretches, where token costs compound.

The 49%/93.7% headline number comes from the single best-case benchmark (EdgeBench); performance was mixed or weaker on Terminal-Bench 4, Lean 4 proof tasks and kernel optimization, which the coverage underplays. Auto-optimized harnesses have a known failure mode of overfitting to their test environments, and there's no released tool, code or direct paper link in this coverage to verify the claims independently; the source (The Decoder) is secondary, not primary reporting.

1. 01Whether Nvidia or the authors release the SoL-Pi code, harness, or paper publicly for independent verification
2. 02Third-party replication or benchmark results outside Nvidia's own 535-environment test set, especially on Terminal-Bench-style tasks
3. 03Whether any coding-agent vendor (Anthropic, OpenAI, Composio) adopts or cites harness-level optimization techniques in a shipped product within the next 2-3 months