Skip to content

Topic

Inference Pricing and Token Economics

Per-token rates, subscription quotas and cost-per-task comparisons across frontier and open-weight providers.

Current stories

productOne report1 publisher

TypeSafe clears Jev's 140,000-person waitlist six days after launch

TypeSafe now fronts every new account $5 of credit it values at roughly 120 million tokens. Decision-model calls are far smaller than LLM completions, so that allowance does not convert into a request count.

Publishers:explainx.ai

Reality

Evidence38
Adoption42
Hype gap+38
Incentives72
Confidence45
buildOne report1 publisher

Fixing the deployment target splits the flash-tier coding leaderboard into three winners

GLM-5.3-Flash leads agentic terminal work, DeepSeek V4 Flash is billed as the cheapest per token, and a 2.52B MiniCPM5-2B runs locally under Apache 2.0. The comparison flags most of those numbers as vendor-reported.

Publishers:dev.to

Reality

Evidence34
Adoption27
Hype gap+26
Incentives58
Confidence41
leadershipOne report1 publisher

Datacentre deals let hyperscalers book revenue years before payment is due

A Guardian column by Heather Stewart argues the nearer risk in AI is financial, counting $132bn of hyperscaler debt issuance this year and a $1.5tn compute bill that lands within about two years.

Publishers:theguardian.com

Reality

Evidence42
Adoption30
Hype gap+25
Incentives55
Confidence46
buildOne report1 publisher

Latency spread narrowed to 38ms from 2353ms when typed questions replaced generated prose

A team that now has access to the model behind a published 193.6x figure measured 12x at the median on its own admin workload, and found that 83 percent of its bill was output tokens the new model does not charge for.

Publishers:dev.to

Reality

Evidence62
Adoption22
Hype gap−20
Incentives35
Confidence55
buildOne report1 publisher

Kimi K3 puts explicit prompt caching on Bedrock behind a 1,024-token minimum prefix

AWS has put Moonshot AI's 2.8-trillion-parameter model behind Bedrock's APIs and data boundary. The explicit prompt caching it ships with only pays back if you reuse a prefix inside half an hour.

Publishers:aws.amazon.com

Reality

Evidence38
Adoption22
Hype gap+32
Incentives90
Confidence55
buildOne report1 publisher

LangChain routes agent control decisions through a classifier call that returns a confidence score

The langchain-typesafe package lets an agent submit its state and a list of pre-defined questions in one request, and the speed figures behind it are TypeSafe's own, measured from laptops beside its own service.

Publishers:runtimewire.com

Reality

Evidence42
Adoption28
Hype gap+38
Incentives72
Confidence52
productOne report1 publisher

TypeSafe leaves stealth with a model whose confidence scores developers have to calibrate themselves

TypeSafe's first model, Jev, answers structured questions with typed output and a confidence measure attached. The account of its launch says developers have to check those scores against real outcomes on their own data first.

Publishers:siliconangle.com

Reality

Evidence26
Adoption7
Hype gap+48
Incentives80
Confidence57
buildOne report1 publisher

A $3,499 Mac Studio saves 22 cents a day against hosted inference in Sunk Cost's model

The calculator prices its featured coding workload at about $6.94 a month through OpenRouter against 26 cents of electricity. The machine is still $3,419 down after a year and 7.97 billion tokens from break-even.

Publishers:runtimewire.com

Reality

Evidence55
Adoption15
Hype gap+10
Incentives30
Confidence55
productOne report1 publisher

DeepSeek prices cached agent input at $0.003 a million tokens off-peak

The rate undercuts the cached-input prices OpenAI and Anthropic publish by more than 130 times, and DeepSeek's own release says the sparse-attention design behind it has untested limits at cache boundaries.

Publishers:dataconomy.com

Reality

Evidence46
Adoption32
Hype gap+18
Incentives72
Confidence55
leadershipOne report1 publisher

Uber halved the cost of an AI session by routing work away from frontier models

Cost per request is down 34% at Uber and cost per session down 52%, and total AI spend has been flat since March even as token use grew. Pinterest and AT&T report similar savings from open models.

Reality

Evidence58
Adoption62
Hype gap+20
Incentives62
Confidence57
leadershipOne report1 publisher

GLM-5.3-Flash benchmarks its tenth-of-the-price claim against its own predecessor

The MIT-licensed 320B model card claims it beats GLM-5.2 at a tenth of the price and approaches Claude Opus 4.8 on coding, but it names no dollar rate, and the comparisons are largely the vendor's own.

Publishers:huggingface.co

Reality

Evidence34
Adoption18
Hype gap+46
Incentives82
Confidence61
buildOne report1 publisher

Thirty-nine retries fit inside the price gap between GLM-5.3-Flash and Opus 4.8

Zhipu's open-weight MoE ties Claude Opus 4.8 on one composite index at roughly a fortieth of its list rate. At that price gap, the practical question stops being which model is better. It becomes how many attempts your router can afford.

Publishers:dev.to

Reality

Evidence24
Adoption31
Hype gap+28
Incentives62
Confidence30
buildOne report1 publisher

Judging the cheap model's output beats guessing which prompt is hard

One team's forty lines of Go moved 81% of requests to a cheaper model and cut the bill 71%, but the arithmetic says the win came from a boring traffic mix and a wide price gap, and the bill it pays is tail latency.

Publishers:dev.to

Reality

Evidence40
Adoption22
Hype gap+20
Incentives45
Confidence38
investOne report1 publisher

Ramp counts 6.1% of AI-spending businesses paying for platforms that serve Chinese weights

The share buying model-serving platforms went from 4.5% in January to 6.1% in July, and two named buyers have now moved production work onto Chinese open weights while incumbent revenue has not yet moved.

Publishers:fortune.com

Reality

Evidence54
Adoption38
Hype gap+21
Incentives66
Confidence55
scienceOne report1 publisher

Frontier scores at $2/$6: Grok 4.6 ties GPT-5.6 on one evaluator's index for a fifth the output price

Artificial Analysis puts Grok 4.6 at 61 on its Intelligence Index, level with GPT-5.6 Sol, at $2/$6 per million tokens. The same pages record 48 seconds to first token.

Reality

Evidence56
Adoption24
Hype gap+24
Incentives63
Confidence50
buildOne report1 publisher

Microsoft's MAI-Thinking-1 lands in Foundry, and .NET teams get a reasoning model without Python

MAI-Thinking-1 is in public preview in Microsoft Foundry at $2 per million input tokens. For C# shops the consequence is an interface swap, not a new runtime to operate.

Publishers:dev.to

Reality

Evidence34
Adoption20
Hype gap+32
Incentives46
Confidence41
investOne report1 publisher

GLM-5.3 Buys Buyers Time: Z.ai's Coding Model Cuts Tokens, Not the Closed-Model Lead

Z.ai says its 743B-parameter GLM-5.3 hits 34.5% on its own code bench using 22% fewer output tokens than GLM-5.2. The weights are still two weeks out.

Publishers:decrypt.co

Reality

Evidence32
Adoption18
Hype gap+38
Incentives76
Confidence36