Skip to content

Project

Artificial Analysis

Independent benchmarking platform (artificialanalysis.ai) that ranks AI language models by quality, price, and speed via comparative leaderboards.

Known aliases

  • AA-LCR
  • artificialanalysis.ai
  • Artificial Analysis index
  • Artificial Analysis Intelligence Index
  • Artificial Analysis LLM leaderboard
  • ArtificialAnlys
  • @ArtificialAnlys
  • Intelligence Index

Current stories

investConfirmed32 publishers

Running Meta's Muse Spark Open locally costs at least $21,598 in Mac Studios

Apple and Meta have enabled Meta's 816-billion-parameter Muse Spark Open model to run locally on clustered Mac Studios. CNBC reported that each 256GB M5 Ultra machine costs at least $10,799, so a two-machine cluster comes to $21,598 or more.

Perspective Coverage

31 publishers
Builder
Builder 41%
Operator
Operator 28%
Investor
Investor 31%

Reality

Evidence55
Adoption30
Hype gap+30
Incentives65
Confidence68
buildConfirmed3 publishers

One early test puts a 120B model at 63 tokens per second on an RTX Spark laptop

NVIDIA's RTX Spark laptops went on sale Oct. 16 from $2,599, with up to 128GB of unified memory. A DEV Community roundup reports 63 tokens per second on a 120B model, but Microsoft's own 128K-prompt test shows a 170-second wait.

Perspective Coverage

3 publishers
Builder
Builder 42%
Operator
Operator 33%
Investor
Investor 25%

Reality

Evidence45
Adoption
Not scored
Hype gap+30
Incentives70
Confidence55
productConfirmed25 publishers

Muse Wonder Full sits just below Claude Opus 5.5 on the Artificial Analysis index, Meta says

Meta launched Muse Wonder and Muse Wonder Full and says they rival the best models from OpenAI and Anthropic. Both reports rest on Meta's own benchmark figures, so teams choosing a vendor have one more candidate to test on their own work.

Perspective Coverage

26 publishers
Builder
Builder 35%
Operator
Operator 28%
Investor
Investor 37%

Reality

Evidence62
Adoption
Not scored
Hype gap+28
Incentives72
Confidence70
buildConfirmed7 publishers

Grok Voice 3.0 reaches 86.9 on Artificial Analysis' speech index at the old $0.08 price

xAI's Grok Voice 3.0 tops Artificial Analysis' speech-to-speech index at $0.08 a minute, the same price as Grok Voice 2.0. The cost case is a per-task comparison with two rivals, and runtimewire reports text input is billed separately.

Perspective Coverage

7 publishers
Builder
Builder 29%
Operator
Operator 43%
Investor
Investor 28%

Reality

Evidence62
Adoption50
Hype gap+30
Incentives70
Confidence66
productConfirmed37 publishers

Google opens Gemini 4 Argon to AI Pro subscribers and keeps Antigravity's own apps on Ultra

Google is rolling out Gemini 4 Argon to AI Pro subscribers in the Gemini app, where it was Ultra-only. Antigravity's own desktop app and CLI still require Ultra, 9to5Google reported.

Perspective Coverage

39 publishers
Builder
Builder 31%
Operator
Operator 39%
Investor
Investor 30%

Reality

Evidence58
Adoption
Not scored
Hype gap+25
Incentives62
Confidence76
investConfirmed25 publishers

Meta's Muse Wonder, at $20 to $200 a month, is framed as a test of its superintelligence team

Meta released Muse Wonder and Muse Wonder Full on Oct. 12, with the Full version limited to paying subscribers. CNBC reported monthly plans between $20 and $200, so Meta's rebuilt AI team now has to earn subscriptions as well as benchmark scores.

Perspective Coverage

25 publishers
Builder
Builder 33%
Operator
Operator 29%
Investor
Investor 38%

Reality

Evidence62
Adoption30
Hype gap+25
Incentives72
Confidence68
buildOne report1 publisher

Google's Gemini 4 Argon turns one table photo into 4,500 robot training episodes

Google says Gemini 4 Argon turned one photo into more than 4,500 training episodes that raised a real robot's success rate from 56 to 75 percent. The Decoder reports the demos still need detailed human prompting, and access is through paid developer programs.

Publishers:the-decoder.com

Reality

Evidence40
Adoption
Not scored
Hype gap+35
Incentives
Not scored
Confidence50
buildOne report1 publisher

Tom's Hardware benchmarks RTX Spark on how long local agents take to finish a task

Tom's Hardware tested Nvidia's RTX Spark in a 128GB Surface Laptop Ultra against an M5 Max MacBook Pro on agent task time. Its headline calls local AI a strength and gaming a weak spot, but the text reviewed here ends before the AI timings.

Publishers:tomshardware.com

Reality

Evidence55
Adoption
Not scored
Hype gap+10
Incentives
Not scored
Confidence50
buildOne report1 publisher

Meta's Muse Wonder Full beats Claude Opus 5.5 by 11 points on SWE-Marathon in Meta's own table

Artificial Analysis scores Meta's Muse Wonder Full at 56, two points behind Claude Opus 5.5 at 58. Meta's own model card has Full ahead on long-running agentic tasks, so the right pick depends on how closely your workload resembles those tasks.

Publishers:dev.to

Reality

Evidence50
Adoption
Not scored
Hype gap+25
Incentives60
Confidence55
buildOne report1 publisher

EcoHash gets nearly 2x from a dense 27B's built-in draft head on a single 96 GB card

EcoHash reports that one vLLM flag took Qwen3.8-27B on a single RTX Pro 6000 from 999.9 to 1954.0 output tokens/sec. The figure comes from its own production config on vLLM 0.27.1, so it is one team's measurement on its own workloads.

Publishers:dev.to

Reality

Evidence45
Adoption
Not scored
Hype gap+12
Incentives70
Confidence50
buildOne report1 publisher

Fish Audio's open-weight Drama 3 tops a pronunciation benchmark at 93.2% under a $500,000 revenue cap

Fish Audio released a 35B mixture-of-experts speech model on Oct 13 that scores 93.2% on Artificial Analysis' pronunciation benchmark. Free commercial use stops at $500,000 in annual revenue, and the two-RTX-3090 setup is one Reddit user's report.

Publishers:dev.to

Reality

Evidence50
Adoption12
Hype gap+25
Incentives
Not scored
Confidence55
productOne report1 publisher

Anthropic's GLM-5.3 warning adds to an open-model fight with money on both sides

Anthropic argued in a report late last month that Z.ai's freely downloadable GLM-5.3 poses a major cyberattack risk. MIT Technology Review says Nvidia's Jensen Huang and Anthropic's Dario Amodei each have money riding on how the open-model fight ends.

Reality

Evidence35
Adoption
Not scored
Hype gap
Not scored
Incentives70
Confidence40
buildOne report1 publisher

Meta's Muse Wonder Full trails Opus 5.5 by two points on the Artificial Analysis index

Meta's Muse Wonder Full scores 56 on Artificial Analysis's Intelligence Index, two points behind Opus 5.5, according to latent.space. Full is limited to Muse Code subscribers, so the Meta Model API serves only Wonder.

Publishers:latent.space

Reality

Evidence58
Adoption
Not scored
Hype gap+12
Incentives
Not scored
Confidence60
buildOne report1 publisher

Self-hosting Mistral Large 4 means loading 1.05 trillion parameters to run 52 billion per token

Mistral AI put Large 4, a 1.05-trillion-parameter mixture-of-experts model, into public preview on Oct. 6 and promised weights by October's end. Self-hosters can size memory now, though Mistral says the training run behind the preview is still going.

Publishers:dev.to

Reality

Evidence50
Adoption
Not scored
Hype gap+20
Incentives65
Confidence55
buildConfirmed22 publishers

Prompt length sets what Anthropic's Haiku 5.5 price cut is worth to each workload

Anthropic launched Claude Haiku 5.5 at an average price about 75% below Haiku 4.5. The saving varies widely with prompt length, so teams moving classification, support or query traffic need to price their own requests before they switch models.

Perspective Coverage

22 publishers
Builder
Builder 47%
Operator
Operator 36%
Investor
Investor 17%

Reality

Evidence66
Adoption30
Hype gap+25
Incentives70
Confidence65
buildConfirmed8 publishers

Cursor's task-cost table shrinks Grok 4.7's 7.5x list-price gap to about 1.9x

SpaceXAI lists Grok 4.7 at $2 and $6 per million tokens against $10 and $50 for GPT-6 Astra and Claude Fable 5.1, and the only per-task figures in the record put a Cursor run at $4.69 against about $9.

Perspective Coverage

8 publishers
Builder
Builder 51%
Operator
Operator 32%
Investor
Investor 17%

Reality

Evidence60
Adoption30
Hype gap+25
Incentives65
Confidence58
buildConfirmed8 publishers

Gemini 3.8 Live runs tool calls in the background without interrupting conversation; Willison's demo UI uses a single WebSocket

Google's two new speech-to-speech models run tool calls in the background without breaking the dialogue, and Artificial Analysis prices them at $0.84 and $3.50 per hour of input audio on one benchmark subset.

Perspective Coverage

8 publishers
Builder
Builder 48%
Operator
Operator 29%
Investor
Investor 23%

Reality

Evidence60
Adoption22
Hype gap+30
Incentives72
Confidence64
buildOne report1 publisher

Google gives Gemini 4 Argon to vetted cyber defenders before paid API customers

Google DeepMind's Gemini 4 Argon, priced at half of Claude Opus 5.5, goes first to vetted cyber defenders, and paid API customers have no date. Until Google sets one, teams can only check its benchmark claims on paper.

Publishers:dev.to

Reality

Evidence35
Adoption15
Hype gap+30
Incentives65
Confidence35
buildConfirmed21 publishers

Mistral's Arthur Mensch claims a cybersecurity edge over unnamed Chinese models

Mistral CEO Arthur Mensch said on October 6th that the company's newest model beats unnamed Chinese rivals on cybersecurity. He gave no tests or scores with the claim, so buyers looking for a supplier outside the US and China cannot yet use it to choose one.

Perspective Coverage

25 publishers
Builder
Builder 38%
Operator
Operator 34%
Investor
Investor 28%

Reality

Evidence60
Adoption20
Hype gap+35
Incentives75
Confidence65

Earlier coverage

  1. GPT-6.1 Sol matched GPT-6 Astra across 15 test runs at 18% of the cost

    Build · October 7, 2026 · Confirmed2 publishers

  2. OpenAI courts builders with a cheaper model and ChatGPT's 1.2 billion weekly users

    Build · September 29, 2026 · Confirmed12 publishers

  3. Astra's Critical cyber rating ships a real-time pause switch inside the Bedrock service boundary

    Build · September 10, 2026 · Confirmed17 publishers

  4. Anthropic's Fable 5.1 moves the hard part from prompting to bounding what it may do

    Build · September 1, 2026 · Confirmed13 publishers

  5. Reflection sells Beam to sovereign-AI buyers on a 3-to-4x inference compute claim

    Build · October 5, 2026 · Confirmed13 publishers

  6. Moonshot's last private round values it at about 167 times revenue ahead of a Hong Kong IPO

    Invest · October 5, 2026 · Confirmed3 publishers

  7. Microsoft's MAI speech lineup documents real-time use only on the voice-output side

    Build · October 1, 2026 · Confirmed7 publishers

  8. Google limits Gemini 4 Argon to select partners in its Fairwind security program

    Product · October 1, 2026 · Confirmed14 publishers

  9. Google publishes Gemini 4 Argon's token prices before most teams can call the model

    Build · September 30, 2026 · Confirmed10 publishers

  10. Sonnet 5.5's extra tokens shrink its half-price edge over Opus to roughly a fifth at max effort

    Invest · September 28, 2026 · Confirmed4 publishers

  11. Gemini 4 Argon costs 2.7 times as much per task as GPT-6.1 Sol at the same token price

    Science · October 1, 2026 · Confirmed4 publishers

  12. One model string moves Vercel AI Gateway traffic to Claude Sonnet 5.5

    Build · September 30, 2026 · Confirmed14 publishers

  13. ElevenLabs aims v4 Turbo at live voice agents with a self-measured 150 ms to first speech

    Build · September 28, 2026 · Confirmed3 publishers

  14. Bedrock serves xAI's Grok 4.7 through the Converse, Responses and Chat Completions APIs

    Build · September 28, 2026 · Confirmed2 publishers

  15. Opus 5.5 matched Opus 5's puzzle answers for up to 69 percent less at its lower default effort

    Build · September 26, 2026 · Confirmed17 publishers

  16. A million-token stranger on OpenRouter, and 30 of 30 tokenizer matches with GLM-5.3

    Build · August 22, 2026 · Confirmed6 publishers

  17. NVIDIA ships Groq 3 LPX and starts quoting inference in tokens per user, not per rack

    Build · August 24, 2026 · Confirmed2 publishers

  18. Nvidia puts a decode chip in the rack, and inference planning gets a second variable

    Product · August 24, 2026 · Confirmed2 publishers

  19. Nvidia's $12.9B Hugging Face deal turns a neutral registry into a vendor dependency

    Build · August 27, 2026 · Confirmed12 publishers

  20. Google splits transcription in two, and quietly absorbs your cleanup layer

    Build · August 26, 2026 · Confirmed6 publishers

  21. Anthropic Cuts Cache-Read Prices by 75%; Cache Reads Were ~60% of a Heavy Agent's Bill Before the Cut

    Invest · September 1, 2026 · Confirmed2 publishers

  22. Anthropic cuts Fable 5.1 prices by 25% and launches two-tier safeguard system with Mythos 5.1

    Leadership · September 1, 2026 · Confirmed3 publishers

  23. Meta keeps Muse Spark 1.3 pricing flat while claiming coding edge over GPT-5.6

    Product · September 3, 2026 · Confirmed3 publishers

  24. Gemini 3.8 Flash's introductory price doubles on December 31, 2026

    Build · September 2, 2026 · Confirmed8 publishers

  25. Spark 1.3's index jump lands on the three tests that carry half the score

    Build · September 3, 2026 · Confirmed6 publishers

  26. Epoch's first-place ranking for GPT-6 Astra rests on a single coding score

    Build · September 4, 2026 · Confirmed2 publishers

  27. DeepSeek's new encoder-decoder splits inference into an 8B prefill and a 16B decode

    Build · September 11, 2026 · Confirmed3 publishers

  28. SpaceXAI plans to retire Grok Voice Transcribe 1.0 weeks after shipping a drop-in successor

    Build · September 18, 2026 · Confirmed2 publishers

  29. xAI holds Grok's $2 token price for a model 40 Elo points behind Fable 5.1

    Invest · September 21, 2026 · Confirmed3 publishers

  30. Opus 5.5 diverts most cybersecurity requests to the older Opus 4.8

    Leadership · September 22, 2026 · Confirmed2 publishers

  31. Sol's 27-cent benchmark task undercuts Opus 5 by more than eleven times

    Invest · September 22, 2026 · Confirmed16 publishers

  32. Opus 5.5's claimed 40% cost cut needs a cache-heavy workload to appear

    Science · September 23, 2026 · Confirmed2 publishers