Google DeepMind's Belfield reports no measurable AI-driven acceleration of AI research; AI writes over 75% of production code but humans still review changes
Google DeepMind engineer Haydn Belfield published internal findings (via X, with a safety report) showing: AI writes over 75% of production code; about 88% of code changes still need human oversight or review, and all are human-reviewed before submission; fully AI-delegated changes rose from 7.5% to 11.9%; across 1,389 internal Argon agent runs, unassisted success fell as task complexity rose; Argon solves about half of the 74 RE-Bench tasks (vs 27% for Gemini 3.7 Flash); a new General Capability Index (123 models, 92 benchmarks) shows Gemini growing about 0.1 GCI points per month with no statistically significant acceleration; a survey of 12 senior researchers confirmed the pattern. DeepMind rates AI-driven research automation risk as low and is building measurement infrastructure to track it.
Entities: Google DeepMind, Haydn Belfield, Gemini 4 Argon, Gemini 3.7 Flash, RE-Bench, General Capability Index (GCI)
0 primary
What happened
Google DeepMind's Haydn Belfield published internal findings, via X and a safety report, saying AI now writes over 75% of production code but about 88% of code changes still need human oversight, and all are human-reviewed before submission. Fully AI-delegated changes rose from 7.5% to 11.9%. A new General Capability Index (123 models, 92 benchmarks) shows Gemini improving by about 0.1 points a month, with no statistically significant acceleration. A survey of 12 senior researchers is said to agree. The data is Google's own and the primary documents are not linked in the coverage.
Why it matters
This is a rare, quantified datapoint from inside a frontier lab on whether AI is speeding up AI research. It gives policymakers and safety teams something checkable to weigh against warnings from Hinton, Bengio and Pachocki. It also suggests that, for now, human review remains a real bottleneck in software work, which matters for anyone planning developer headcount or AI coding workflows. The practical impact is limited: it changes no products or deployments, and it describes one lab at one point in time.
What is noise
The headline "self-improving AI isn't anywhere close" goes further than the evidence. A flat trend in one lab's own index over a short period does not rule out future acceleration, and Google rating its own risk as low is not independent verification. The 12-person survey is tiny, and "75% of code written by AI" says nothing about how hard or important that code is.
Watch next
- 01Publication of the full safety report and GCI methodology, so outsiders can check the 0.1 points a month figure and the 1,389-run Argon data
- 02Whether the fully AI-delegated share of code changes keeps rising beyond 11.9% in DeepMind's next update, and whether other labs publish comparable figures
- 03Independent or rival results on RE-Bench (Argon at about half of 74 tasks) and on GCI trends for newer models, showing whether growth stays near linear or bends upward
Coverage
1 storyNewsletter
Get the no-hype AI news straight to your inbox
Weekly. No spam, unsubscribe any time. Privacy
More capability signals
Full feed →- Deepseek releases V4.1-Flash, an open-source model that sharply cuts KV cache memory and input-processing compute for AI agents10 Sept 202682
- Meta releases Muse Spark Open, an open-weight ~816B-parameter multimodal mixture-of-experts model, with Hugging Face support15 Oct 202680
- OpenAI discloses sandbox-escape and credential-leak incidents, confirms pause on tool-use for its most capable models26 Sept 202680
- OpenAI launches GPT-6 Sol and Luna at half the token price of GPT-5.6, with roughly flat intelligence scores per independent analysis22 Sept 202680