Skip to content

Topic

LLM Inference Pricing

Token pricing mechanics, promotional rates and scheduled resets that determine what model usage actually costs.

Current stories

buildOne report1 publisher

Bedrock's two GPT-6 Astra endpoints split prompt caching from invocation logging

Amazon Bedrock serves GPT-6 Astra through two endpoints that split explicit prompt caching from invocation logging, a dev.to analysis of the model card finds. Teams have to choose per request path, and the model's end-of-life, no sooner than September 8, 2027, sets how long that choice must hold.

Publishers:dev.to

Reality

Evidence50
Adoption
Not scored
Hype gap0
Incentives
Not scored
Confidence45
leadershipOne report1 publisher

Lower-priced AI models ran up bigger bills in 32% of head-to-head tests

Researchers led by Lingjiao Chen of Stanford found the AI model with the lower list price cost more in 106 of 336 head-to-head comparisons. For anyone setting an AI budget, the finding means per-task cost has to be measured on their own workloads before a model is chosen.

Publishers:implicator.ai

Reality

Evidence62
Adoption
Not scored
Hype gap+8
Incentives45
Confidence58
buildOne report1 publisher

Grok 4.7 doubles cost per task at an unchanged per-token price

Grok 4.7 keeps Grok 4.6's $2/$6 token price yet costs $3.74 per task against $1.86, by Artificial Analysis' measurement. Teams that budget from the price sheet will undercount agent spend until they measure tokens per task on their own work.

Publishers:dev.to

Reality

Evidence58
Adoption
Not scored
Hype gap+45
Incentives55
Confidence55
buildConfirmed3 publishers

Kimi K3 on its cheapest host undercuts Fireworks' Ember-1 despite a 23% cut in reasoning tokens

Fireworks' Ember-1 used 23% fewer reasoning tokens than Kimi K3 in The New Stack's tests, yet Kimi on the cheapest host would cost $1.96 to Ember's $2.48. Ember beats Fireworks' own Kimi rate and loses at the cheapest, so buyers have to price the host before the model.

Perspective Coverage

3 publishers
Builder
Builder 52%
Operator
Operator 30%
Investor
Investor 18%

Reality

Evidence55
Adoption30
Hype gap+25
Incentives70
Confidence58
buildConfirmed14 publishers

Jev turns a catalogue ID from a prompt constraint into part of the decision domain

TypeSafe's Jev answers typed questions with floats and probabilities. An invoice pipeline that handed it classification and catalogue selection still needs a generative model for field extraction and for the note a human reads.

Perspective Coverage

14 publishers
Builder
Builder 53%
Operator
Operator 31%
Investor
Investor 16%

Reality

Evidence55
Adoption40
Hype gap+30
Incentives65
Confidence55
buildOne report1 publisher

Choosing US-only inference for Kimi K3 costs about 11% more than Bedrock's global profile

AWS's walkthrough pairs the OpenCode terminal agent with open weight models on Amazon Bedrock and keeps code inside your own account, and the only price difference it publishes is the 10 percent discount for letting a request route anywhere.

Publishers:aws.amazon.com

Reality

Evidence38
Adoption20
Hype gap+35
Incentives88
Confidence45
leadershipOne report1 publisher

Flagship output tokens now run about what GPT-3.5-level capability cost in 2022

Kion's chief executive argues in Forbes that tokens need cloud-style FinOps discipline, citing a 286-fold fall in per-token inference cost alongside LLM spending that tripled in 2025 and 93 percent of surveyed firms overrunning their AI budgets.

Publishers:forbes.com

Reality

Evidence30
Adoption
Not scored
Hype gap+45
Incentives85
Confidence62
productOne report1 publisher

Fireworks' own DeepSWE numbers put four coding models inside the noise band

The vendor selling the cheapest model in the comparison reports a 0.7-point quality spread across four frontier models against run-to-run variation of 1.4 to 3.2 points. That leaves price per task, $0.43 against an implied $6.45 for GPT-6 Astra.

Publishers:fireworks.ai

Reality

Evidence42
Adoption18
Hype gap+28
Incentives88
Confidence58
buildOne report1 publisher

Codex runs on DeepSeek once you declare what DeepSeek can do

A dev.to walkthrough moves Codex onto DeepSeek's API using two local config files. Codex accepts the capability figures you write into them, and the cost case in the post compares one metered API against another.

Publishers:dev.to

Reality

Evidence34
Adoption8
Hype gap+45
Incentives30
Confidence30
buildOne report1 publisher

GLM-5.3-Flash buys seven retries for the price of one Kimi K3 call

Artificial Analysis scores GLM-5.3-Flash 42 at $0.25 a task and Kimi K3 44 at $2.00 a task. At eight-to-one on price, a two-point composite gap settles nothing, and the cost of an hour of human review decides it.

Publishers:dev.to

Reality

Evidence56
Adoption
Not scored
Hype gap+12
Incentives30
Confidence55
buildOne report1 publisher

GLM-5.3-Flash spends 2.6x the tokens to pass the same 12 hidden tests

The OpenRouter rate card puts nearly 16x between the two models. The finished-task bill came in at 3.4x on one coding spec and 30x on a logic puzzle, and that gap is why the task, not the token, is the unit worth pricing.

Publishers:thenewstack.io

Reality

Evidence62
Adoption20
Hype gap+42
Incentives58
Confidence55
buildOne report1 publisher

DeepSeek V4 moves the coding-model decision into the finance column

Open weights under MIT, a million-token default context and output priced roughly 29x under Claude Opus make the swap cheap to try. The ceiling is the agent loop, and the source's own price arithmetic does not close.

Publishers:dev.to

Reality

Evidence34
Adoption27
Hype gap+18
Incentives48
Confidence38