Skip to content

Benchmark

Artificial Analysis Intelligence Index

A composite benchmark that scores large language models across multiple evaluations into one comparative intelligence rating from Artificial Analysis.

Known aliases

  • AAII
  • AA Index
  • AA Intelligence Index
  • Artificial Analysis
  • Artificial Analysis Intelligence Index v4.1.1
  • Intelligence Index v4.1.1

Current stories

buildConfirmed7 publishers

Xiaomi priced six days of reinforcement learning at $3.47 million

Xiaomi's $850,000 and $2.62 million cover 30 reinforcement-learning steps apiece on models it had already pretrained. Xiaomi published the environments and the RL code but not the 7,000-plus task datasets behind them.

Perspective Coverage

7 publishers
Builder
Builder 56%
Operator
Operator 23%
Investor
Investor 21%

Reality

Evidence60
Adoption25
Hype gap+30
Incentives65
Confidence62
investConfirmed12 publishers

Google prices its third-ranked Gemini 4 Argon at half the cost of Anthropic's Claude Opus 5.5

Google priced Gemini 4 Argon at half Claude Opus 5.5's per-token rate for a model one composite index ranks third, behind two Anthropic models. On price alone it only matches OpenAI's newly discounted GPT-6.1 Sol, so the price edge Google is selling is against Anthropic.

Perspective Coverage

12 publishers
Builder
Builder 36%
Operator
Operator 35%
Investor
Investor 29%

Reality

Evidence55
Adoption20
Hype gap+30
Incentives65
Confidence55
buildOne report1 publisher

Grok 4.7 doubles cost per task at an unchanged per-token price

Grok 4.7 keeps Grok 4.6's $2/$6 token price yet costs $3.74 per task against $1.86, by Artificial Analysis' measurement. Teams that budget from the price sheet will undercount agent spend until they measure tokens per task on their own work.

Publishers:dev.to

Reality

Evidence58
Adoption
Not scored
Hype gap+45
Incentives55
Confidence55
leadershipConfirmed6 publishers

Gemini 4 Argon ties two rivals on a leading AI index while some Google staff doubt its coding

Google's Gemini 4 Argon tied GPT-6 Astra and Claude Fable 5.1 at 53 on the Artificial Analysis index, though some Google staff say its coding lags. Google disputes them, and until paid API access has a date, buyers cannot check the score on their own code.

Perspective Coverage

6 publishers
Builder
Builder 37%
Operator
Operator 35%
Investor
Investor 28%

Reality

Evidence55
Adoption15
Hype gap+25
Incentives65
Confidence55
scienceConfirmed4 publishers

Gemini 4 Argon costs 2.7 times as much per task as GPT-6.1 Sol at the same token price

Google's Gemini 4 Argon matches GPT-6.1 Sol's $2/$10 token price but costs 2.7 times as much per task, according to Artificial Analysis. Argon uses more tokens per job, so buyers still have to compare frontier models by cost per completed task.

Perspective Coverage

4 publishers
Builder
Builder 36%
Operator
Operator 34%
Investor
Investor 30%

Reality

Evidence68
Adoption15
Hype gap+20
Incentives55
Confidence65
buildOne report1 publisher

Mistral takes 3 billion euros from a Samsung-led round to build compute it owns in Europe

Mistral AI raised 3 billion euros in a Series D led by Samsung Electronics, at a post-money valuation above 21 billion euros. Buyers who choose it for data residency get a label that covers where models run, on an API priced at 11 to 19 times the open-model median.

Publishers:dev.to

Reality

Evidence45
Adoption55
Hype gap+25
Incentives65
Confidence45
buildOne report1 publisher

Gemini 3.8 Flash ties Opus 5 on DeepSWE at a price Google doubles on January 1

Google's Gemini 3.8 Flash ties Claude Opus 5 at 74% on DeepSWE for $2.36 a task, at an introductory price that doubles on January 1, 2027. For agent workloads, the comparison that holds up after January is cost per finished task, set by steps taken as much as by rate.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap+25
Incentives60
Confidence50
productConfirmed3 publishers

Meta keeps Muse Spark 1.3 pricing flat while claiming coding edge over GPT-5.6

Alexandr Wang says the new model costs developers no more than 1.2 and finishes the same work on about a quarter fewer tokens. That is a real saving on high-volume code generation and a rounding error most other places.

Perspective Coverage

3 publishers
Builder
Builder 40%
Operator
Operator 32%
Investor
Investor 28%

Reality

Evidence55
Adoption30
Hype gap+25
Incentives70
Confidence55
buildConfirmed6 publishers

Spark 1.3's index jump lands on the three tests that carry half the score

Meta's fourth Muse Spark in five months gains four points on Artificial Analysis' Intelligence Index, almost entirely in agentic tests, while two scores fall and the tier Meta benchmarked against rivals is still a limited preview.

Perspective Coverage

6 publishers
Builder
Builder 52%
Operator
Operator 26%
Investor
Investor 22%

Reality

Evidence68
Adoption25
Hype gap+30
Incentives65
Confidence70
buildConfirmed3 publishers

DeepSeek's new encoder-decoder splits inference into an 8B prefill and a 16B decode

V4.1-Flash retires the V4 Pro line and carries two active-parameter counts, 763B total with 8B on input tokens and 16B on output, so one sizing number no longer covers both phases of a request. Baseten had it running on day zero.

Perspective Coverage

3 publishers
Builder
Builder 40%
Operator
Operator 28%
Investor
Investor 32%

Reality

Evidence60
Adoption35
Hype gap+25
Incentives40
Confidence58
productOne report1 publisher

Xiaomi's MiMo-V2.6-Pro leads the open-weight index at $0.87 per million output tokens

Artificial Analysis scores the new Xiaomi model first among open weights and twelve points behind Claude Opus 5.5, and the cheaper Flash tier is the one an operator should put in front of a real queue.

Publishers:thenextweb.com

Reality

Evidence55
Adoption30
Hype gap+15
Incentives72
Confidence55
buildOne report1 publisher

A Lnkr payload sat in URLScan for nearly two and a half years marked "No classification"

Cloudflare says its graph model flagged eight malicious scripts running on live storefronts. A retrospective check put seven of the eight outside VirusTotal entirely. URLScan flagged none of the eight as malicious.

Reality

Evidence45
Adoption40
Hype gap+30
Incentives85
Confidence50
buildOne report1 publisher

Filling Qwen 3.8 27B's native context costs about as much memory as its weights

Alibaba's 27B scores 52 on the Artificial Analysis index from a 17GB quantized file. Filling its 262,144-token window needs roughly 16 GiB of KV cache on top of that, so the file size is the smaller half of the sizing question.

Publishers:dev.to

Reality

Evidence30
Adoption15
Hype gap+45
Incentives50
Confidence32
buildOne report1 publisher

A $3,499 Mac Studio saves 22 cents a day against hosted inference in Sunk Cost's model

The calculator prices its featured coding workload at about $6.94 a month through OpenRouter against 26 cents of electricity. The machine is still $3,419 down after a year and 7.97 billion tokens from break-even.

Publishers:runtimewire.com

Reality

Evidence55
Adoption15
Hype gap+10
Incentives30
Confidence55
investOne report1 publisher

Artificial Analysis's Intelligence Index carries a quarter of Korea's sovereign AI score

Korea's Dokpamo program gives the benchmarking firm's index 25 of the 100 points that decide which teams advance. In the results published on August 27, the team that led that component finished last of the four.

Reality

Evidence30
Adoption55
Hype gap+25
Incentives55
Confidence38
buildOne report1 publisher

Requests to deepseek-v4-pro start returning V4.1-Flash on 14 September at 04:00 UTC

The model string keeps working after the cutover, so a pinned request comes back from V4.1-Flash. By the figures in the dev.to write-up, that model scores 90.6 on Terminal-Bench 2.1 and 42.3 on SimpleQA, against V4-Pro's 55.2.

Publishers:dev.to

Reality

Evidence38
Adoption40
Hype gap+30
Incentives70
Confidence45
investOne report1 publisher

OpenAI's cost-per-task argument buys Luna room for ten failed tries before it loses on price

Sarah Friar told Goldman Sachs' technology conference that a pricier model can be cheaper when it needs fewer tries, a claim Artificial Analysis puts at an eleven-to-one price spread against seven index points running the other way.

Reality

Evidence34
Adoption38
Hype gap+30
Incentives80
Confidence45
buildOne report1 publisher

Stripped GLM-5.3-Flash weights show what Z.ai's MIT license permits

DeAlignAI's downloadable FP8 build is the license working exactly as written, while its self-reported 320-of-320 HarmBench run remains unchecked by any outside researcher and measures compliance, not capability.

Publishers:runtimewire.com

Reality

Evidence46
Adoption20
Hype gap+18
Incentives72
Confidence55

Earlier coverage

  1. Astra's 99.9% holds up only on the harness OpenAI ran itself

    Invest · September 4, 2026 · One report1 publisher

  2. GLM-5.3 changed nothing but the training environments. That is the whole test.

    Build · August 19, 2026 · Confirmed3 publishers

  3. Three frontier launches in a day, all pitched on price. Open weights set the ceiling.

    Build · August 14, 2026 · Confirmed4 publishers