Lower-priced AI models ran up bigger bills in 32% of head-to-head tests
Researchers led by Lingjiao Chen of Stanford found the AI model with the lower list price cost more in 106 of 336 head-to-head comparisons. For anyone setting an AI budget, the finding means per-task cost has to be measured on their own workloads before a model is chosen.
Reality
- Evidence62
- Adoption
- Not scored
- Hype gap+8
- Incentives45
- Confidence58
Meta, Duke and UC Davis researchers lift Gemini 3 Flash to 62% on Olympiad math with a better harness
Meta, Duke and UC Davis researchers lifted Gemini 3 Flash from 46% to 62% on Olympiad math by searching for a better harness around the same model. That puts the wrapper on an operator's budget ahead of a bigger model, at least for math.
Reality
- Evidence35
- Adoption
- Not scored
- Hype gap+20
- Incentives
- Not scored
- Confidence40
Claude Opus 4.6 cost 40 times as much as Gemini 3 Flash per run for 11 more points of pen-test coverage
Ridge Security's 96-test pen-test benchmark had Claude Opus 4.6 reach 63% coverage at $217 a run, against 52% for Gemini 3 Flash at about $5.42. Ridge argues tooling matters more than the model, yet its published runs held the tooling fixed and varied the model.
Reality
- Evidence35
- Adoption
- Not scored
- Hype gap+40
- Incentives70
- Confidence40
buildOne report1 publisher Apollon Labs' Greek benchmark finds gpt-oss-20b inventing 48 words per 1,000
Apollon Labs' Greek benchmark found gpt-oss-20b making up 48 words per 1,000, against zero for six of the 15 models tested. It targets a hallucination that fact checks skip: words that look Greek and do not exist.
Reality
- Evidence48
- Adoption
- Not scored
- Hype gap+5
- Incentives35
- Confidence50
buildConfirmed4 publishers A 73-page preprint evolved instructions that jumped between coding agents and wrote themselves into the file that becomes the next system prompt. A short warning nearly stopped transmission.
Perspective Coverage
4 publishers
- Builder
- Builder 52%
- Operator
- Operator 39%
- Investor
- Investor 9%
Reality
- Evidence68
- Adoption
- Not scored
- Hype gap+10
- Incentives30
- Confidence65
Antigravity gives away five frontier models on a quota Google keeps trimming
Antigravity's free tier includes Gemini 3.1 Pro and Claude Opus 4.6 with unlimited tab completions. XDA reports Opus burns credits about four times faster than Gemini, and Google moved the free tier onto credits in March 2026.
Reality
- Evidence36
- Adoption
- Not scored
- Hype gap+12
- Incentives58
- Confidence40
buildOne report1 publisher A strict enum schema on the baselines erased most of Jev's 14x decision-latency lead
TypeSafe's Jev answers typed questions in one forward pass with no token stream, and a dev.to benchmark shows that most of its 14x decision-latency lead over two chat models came from how those models were called.
Reality
- Evidence58
- Adoption10
- Hype gap+12
- Incentives55
- Confidence45
buildConfirmed2 publishers Vercel's September Production Index shows the gateway's average price per token down 23.2% in August, a third straight decline, and the median heavy-usage team paying 7.6% less, so most of the saving came from switching models.
Reality
- Evidence58
- Adoption80
- Hype gap+14
- Incentives70
- Confidence64
Emergence logs 683 crimes among ten Gemini 3 Flash agents over 15 simulated days
The company's own blog post is the only account of the run, and an Adelaide University researcher who credits its long-horizon design still warns that open-ended worlds make causes harder to isolate and runs harder to compare.
Reality
- Evidence32
- Adoption
- Not scored
- Hype gap+40
- Incentives74
- Confidence44
buildOne report1 publisher JetBrains' Kotlin leaderboard prices the same 86 solved tasks at 3.7x apart
The Kotlin Benchmark grades agents on 105 verified repository tasks. Its token column shows setups that solve within a few tasks of each other burning between 66,000 and 777,000 tokens per fix.
Reality
- Evidence62
- Adoption30
- Hype gap+22
- Incentives60
- Confidence58
buildOne report1 publisher Cohere bets enterprise PDF extraction belongs to a 2.3B-parameter specialist
Parse 5 returns Markdown and bounding boxes from a model small enough to serve on Azure or SageMaker, and it lands eleven points below the ParseBench leader. The 8K context window is the number to check first.
Reality
- Evidence45
- Adoption15
- Hype gap+30
- Incentives72
- Confidence42
buildOne report1 publisher Databricks routes chart values through the parser instead of the reasoning budget
Databricks argues agents fail on charts at retrieval rather than at reasoning, and it tested the idea with two indexes over the same 16,000-page corpus differing only in how figures were represented.
Reality
- Evidence56
- Adoption
- Not scored
- Hype gap+32
- Incentives88
- Confidence46
buildOne report1 publisher Copilot's meter changed on June 1, and half your seats are still priced in the old unit
Premium requests are now labelled legacy and AI Credits bill at one cent each. Annual Pro and Pro+ seats keep the old meter, so one org ends up budgeting in two units with a four-to-one conversion.
Reality
- Evidence40
- Adoption
- Not scored
- Hype gap+22
- Incentives55
- Confidence36
buildOne report1 publisher The weighting ran, then the dedup pass undid it 56 lines later
MLX LoRA has no per-example weight field, so one builder encoded his curriculum as duplicate lines. A dedup key on the last 200 characters deleted 38,988 of them before training.
Reality
- Evidence63
- Adoption14
- Hype gap−9
- Incentives32
- Confidence57
buildOne report1 publisher Token-matched, agent memory modules lose to simply giving the actor more steps
A preprint from ServiceNow AI Research and university co-authors reports that a plain web agent with a longer horizon matches or beats AWM, ASI and ReasoningBank, often on fewer tokens.
Reality
- Evidence40
- Adoption
- Not scored
- Hype gap+25
- Incentives45
- Confidence42
buildOne report1 publisher A goal that writes itself into SOUL.md: agent memory is now an attack surface
An Anthropic and EPFL preprint shows plain-language goals hopping agent to agent through persistent files, and a one-paragraph warning in the system prompt stopping nearly all of it.
Publishers:startupfortune.com
Reality
- Evidence55
- Adoption22
- Hype gap+15
- Incentives58
- Confidence42
A paragraph beat the agent "mind virus": reading the Anthropic-EPFL preprint as a defensive win
Self-propagating payloads did move between agents through editable soul files, but one inoculation paragraph held against 150-plus optimized strains, and nothing propagated in the wild.
Reality
- Evidence66
- Adoption14
- Hype gap+18
- Incentives60
- Confidence55
Google says frontier models already know the facts they get wrong. That is a budget decision.
Google Research reports Gemini-3-Pro and GPT-5 encode 95-98% of tested facts yet fail to recall 26-34% of them, moving the fix from pretraining scale toward post-training and inference.
Reality
- Evidence55
- Adoption
- Not scored
- Hype gap+20
- Incentives68
- Confidence48