Skip to content

Benchmark

GDPval-AA

Artificial Analysis's version of OpenAI's GDPval, which tests AI models on real-world professional work tasks and ranks them by pairwise comparison.

Known aliases

  • GDPval-AA v2.1

Current stories

investConfirmed5 publishers

Cached context shrinks the discount from Anthropic's half-price Sonnet 5.5

Anthropic released Sonnet 5.5 at $2 and $10 per million input and output tokens, half the Opus 5.5 rate. How much a buyer saves by moving work down a tier depends on tokens burned per task and on cache reads priced identically on both models.

Perspective Coverage

5 publishers
Builder
Builder 46%
Operator
Operator 38%
Investor
Investor 16%

Reality

Evidence55
Adoption35
Hype gap+20
Incentives70
Confidence60
productConfirmed11 publishers

Sonnet 5.5 comes within two points of Opus 5.5 at half the per-token price

Anthropic says Sonnet 5.5 nearly ties Opus 5.5, 1,844 to 1,846, on an everyday-work benchmark while running more than 30% faster than Sonnet 5. For teams paying double per token for Opus, Sonnet becomes the sensible default, with Opus kept for long, ambiguous jobs.

Perspective Coverage

11 publishers
Builder
Builder 36%
Operator
Operator 43%
Investor
Investor 21%

Reality

Evidence45
Adoption50
Hype gap+25
Incentives65
Confidence55
buildConfirmed6 publishers

Spark 1.3's index jump lands on the three tests that carry half the score

Meta's fourth Muse Spark in five months gains four points on Artificial Analysis' Intelligence Index, almost entirely in agentic tests, while two scores fall and the tier Meta benchmarked against rivals is still a limited preview.

Perspective Coverage

6 publishers
Builder
Builder 52%
Operator
Operator 26%
Investor
Investor 22%

Reality

Evidence68
Adoption25
Hype gap+30
Incentives65
Confidence70
productConfirmed7 publishers

Box measured Claude Opus 5.5 using a third of the tokens Opus 5 needed

Anthropic priced Opus 5.5 tokens 20 percent below Opus 5 and raised five-hour usage limits by the same amount. The larger saving in the launch is a token count from one customer's evaluation of its own content.

Perspective Coverage

7 publishers
Builder
Builder 41%
Operator
Operator 38%
Investor
Investor 21%

Reality

Evidence45
Adoption30
Hype gap+35
Incentives60
Confidence60
investOne report1 publisher

Anthropic cuts Opus 5.5 prices 20% on tokens, 60% on cache reads, citing fewer tokens burned for 40% total savings

Every token price on Claude Opus 5.5 fell 20% except cache reads, which dropped 60% to 20 cents a million. For the advertised 40% saving to come from price alone, half a buyer's Opus 5 bill has to be cache reads.

Reality

Evidence38
Adoption24
Hype gap+32
Incentives78
Confidence44
leadershipOne report1 publisher

Anthropic sold about 8 percent of itself for $30 billion

The Series G prices Claude at roughly 27 times a run-rate figure Anthropic reports itself. The enterprise buyers supplying that growth have no public view of what the new shareholders received.

Publishers:anthropic.com

Reality

Evidence38
Adoption58
Hype gap+25
Incentives88
Confidence55
leadershipOne report1 publisher

GLM-5.3-Flash benchmarks its tenth-of-the-price claim against its own predecessor

The MIT-licensed 320B model card claims it beats GLM-5.2 at a tenth of the price and approaches Claude Opus 4.8 on coding, but it names no dollar rate, and the comparisons are largely the vendor's own.

Publishers:huggingface.co

Reality

Evidence34
Adoption18
Hype gap+46
Incentives82
Confidence61
leadershipOne report1 publisher

Anthropic ships a price dial with its new model, and that is now the buying decision

Claude Opus 5 is pitched as near-frontier at half the cost. The cost multiple moves with the workload, and every figure on offer is the vendor's own.

Publishers:anthropic.com

Reality

Evidence30
Adoption32
Hype gap+34
Incentives88
Confidence52
buildOne report1 publisher

Artificial Analysis moves eval onto your data, and turns model choice into procurement

Optima lets buyers build benchmarks from their own datasets and agent traces, then scores candidate models on quality, cost per task and time per task.

Publishers:the-decoder.com

Reality

Evidence34
Adoption16
Hype gap+22
Incentives71
Confidence33