Skip to content

Benchmark

SemiAnalysis AgentX

AgentX is a SemiAnalysis benchmark that replays real Claude Code agentic-coding sessions via AIPerf to measure AI chips' tokens per megawatt and latency.

Known aliases

  • AgentX
  • AgentX v1.0

Current stories

investConfirmed7 publishers

OpenAI's first chip beat merchant silicon in 16 months. The moat was never the fab

Jalapeno's lead is measured against last generation and the volumes are tiny, but a first-pass ASIC clearing Nvidia, AMD and Google parts reprices the design barrier, not the supply chain.

Perspective Coverage

7 publishers
Builder
Builder 30%
Operator
Operator 24%
Investor
Investor 46%

Reality

Evidence50
Adoption8
Hype gap+40
Incentives65
Confidence55
buildOne report1 publisher

NVIDIA's 3.7x Vera Rubin figure comes from Qwen3-VL on vLLM and Dynamo

MLPerf Inference v6.1 preview submissions put Vera Rubin NVL72 at up to 3.7x GB300 on Qwen3-VL and up to 2.5x on DeepSeek-R1, on two different inference frameworks. The four-rack 99% scaling result is an offline number.

Reality

Evidence45
Adoption30
Hype gap+35
Incentives85
Confidence55
investOne report1 publisher

Rubin shows 7x tokens per megawatt and over 2x profit per gigawatt versus Blackwell, SemiAnalysis says

SemiAnalysis says its AgentX benchmark clocked Nvidia's Vera Rubin NVL72 at up to seven times Blackwell's token throughput per megawatt on pre-release software, and puts the profit gain at over two times per gigawatt.

Reality

Evidence46
Adoption29
Hype gap+16
Incentives67
Confidence41
buildOne report1 publisher

OpenAI's Broadcom ASIC buys GPU negotiating leverage before it deploys a single rack

OpenAI published a benchmark win on three large models, but the figure a GPU vendor has to price is the 10-gigawatt Broadcom program running through 2029, with racks targeted from the second half of 2026.

Publishers:dev.to

Reality

Evidence44
Adoption8
Hype gap+17
Incentives74
Confidence46
leadershipOne report1 publisher

Nvidia's agent-workload lead scales with interactivity, and the second-source budget line does not

SemiAnalysis's AgentX replays recorded coding-agent sessions instead of fixed prompts. On that traffic, the reported Nvidia-AMD cost gap grows as the interactivity target rises.

Publishers:forbes.com

Reality

Evidence46
Adoption24
Hype gap+34
Incentives58
Confidence44
buildOne report1 publisher

A benchmark that replays real agent sessions gives back less of the generational win

SemiAnalysis has pushed fixed-length serving into maintenance mode. On replayed Claude Code traffic, NVIDIA's GB300 is credited with 15x Hopper, against 40x over H200 on the retired static test.

Reality

Evidence34
Adoption18
Hype gap+42
Incentives88
Confidence61