Skip to content

Topic

AI R&D automation

The use of AI systems to perform research and engineering tasks that build further AI systems, and efforts to measure how much of that work is automated.

Current stories

leadershipConfirmed3 publishers

Claude graded the index that credits it with leading 26% of Anthropic's R&D

Anthropic has put a number on how much of its own AI research Claude now runs. The number comes out of a pipeline in which a Claude agent catalogued the tasks and a separate Claude judge scored them.

Perspective Coverage

3 publishers
Builder
Builder 27%
Operator
Operator 33%
Investor
Investor 40%

Reality

Evidence45
Adoption60
Hype gap+25
Incentives60
Confidence55
buildOne report1 publisher

Anthropic scores Claude as leading 26% of measured R&D with a prototype that uses Claude to judge

Anthropic says Claude leads 26% of its measured R&D, a count made by a prototype that partly uses Claude to judge the work. OpenAI's 3.1 agent workdays per human workday measures effort, and neither figure shows whether AI is speeding up AI research.

Publishers:theneuron.ai

Reality

Evidence38
Adoption55
Hype gap+20
Incentives55
Confidence42
buildConfirmed6 publishers

Anthropic's 26% figure grades Claude's R&D tasks by how much human steering they took

The lab says Claude leads 26% of its model research and collaborates on about 90%, with both tiers defined by how closely a human directs each task, and it wants rival labs publishing the same measure.

Perspective Coverage

6 publishers
Builder
Builder 39%
Operator
Operator 33%
Investor
Investor 28%

Reality

Evidence50
Adoption65
Hype gap+30
Incentives70
Confidence60
securityOne report1 publisher

METR let Anthropic review and edit its Claude Opus 5.5 evaluation summary before sign-off

METR's predeployment report on Claude Opus 5.5 names its five test tasks and the ten business days of API access behind them. It also states that the work was not meant to verify Anthropic's policy thresholds and did not assess alignment.

Publishers:metr.org

Reality

Evidence60
Adoption22
Hype gap+8
Incentives65
Confidence57
productConfirmed3 publishers

Anthropic reports Claude leading 26% of its model R&D on a definition it wrote itself

Anthropic says Claude leads 26 percent of its model research and development and takes part in more than 90 percent of it. The company wants rival labs to publish the same index so the numbers can be compared over time.

Perspective Coverage

3 publishers
Builder
Builder 30%
Operator
Operator 42%
Investor
Investor 28%

Reality

Evidence46
Adoption44
Hype gap+24
Incentives74
Confidence62
securityOne report1 publisher

METR clocks the Claude 3.7 Sonnet agent at 50% success on 55-minute expert tasks

METR also had the agent match the median human expert on five AI R&D tasks, using 32 hours of wall clock against the humans' eight, assembled from attempts of two hours or less. The confidence intervals still overlap the other public models it has tested.

Publishers:metr.org

Reality

Evidence58
Adoption25
Hype gap−10
Incentives40
Confidence55
leadershipOne report1 publisher

Anthropic's own index rates Claude as leading 26% of its AI R&D work

The lab published a prototype index of how much of its own AI research Claude now leads, alongside a promise to embed outside evaluators with access comparable to what its internal risk teams get. The figures are dated August 2026.

Publishers:anthropic.com

Reality

Evidence38
Adoption32
Hype gap+22
Incentives74
Confidence46