Skip to content

Benchmark

Terminal-Bench 3.0

Third version of the Terminal-Bench suite, which scores AI models on agentic tasks carried out in a command-line terminal; used to compare coding agents.

Known aliases

  • Terminal Bench 3.0

Current stories

buildOne report1 publisher

DeepSeek reroutes every V4-Pro API request to V4.1-Flash from 14 September

Flash's off-peak input price is under a quarter of what V4-Pro cost, and on DeepSeek's own table it beats the old Pro checkpoint on Terminal-Bench, but it scores 36.8 on Humanity's Last Exam and no V4.1-Pro has a date.

Publishers:dev.to

Reality

Evidence42
Adoption52
Hype gap+30
Incentives72
Confidence40
buildOne report1 publisher

Baseten's inference essay hands buyers a test for the vendor's own throughput claims

The framework separates configuration choices that move a deployment along a latency and throughput frontier from advances that move the frontier itself, which is the distinction you need before trusting anyone's benchmark table.

Publishers:runtimewire.com

Reality

Evidence36
Adoption24
Hype gap+14
Incentives81
Confidence51
buildOne report1 publisher

Z.ai pays for ZCode users in tokens, not cash: 100 million each to 50,000 signups

The 5 trillion token ceiling only binds if every allocation is claimed and then spent. Until it is, this is a short window to test a rival coding agent on someone else's inference bill.

Publishers:runtimewire.com

Reality

Evidence32
Adoption24
Hype gap+28
Incentives82
Confidence46
productOne report1 publisher

Z.ai's GLM-5.3 beats Claude on CyberGym, then hands out the weights

Z.ai says its new model tops CyberGym and leads open-source models on Terminal Bench 3.0. The weights go to Hugging Face within two weeks, which is the part security teams should read twice.

Publishers:siliconangle.com

Reality

Evidence28
Adoption18
Hype gap+38
Incentives78
Confidence34
investOne report1 publisher

GLM-5.3 Buys Buyers Time: Z.ai's Coding Model Cuts Tokens, Not the Closed-Model Lead

Z.ai says its 743B-parameter GLM-5.3 hits 34.5% on its own code bench using 22% fewer output tokens than GLM-5.2. The weights are still two weeks out.

Publishers:decrypt.co

Reality

Evidence32
Adoption18
Hype gap+38
Incentives76
Confidence36
buildOne report1 publisher

GLM-5.3 is a paper, not an endpoint: Z.ai publishes research before weights

Z.ai's August 14 post claims post-training gains for coding agents, but the company's release notes still stop at GLM-5.1 and there is no API endpoint, model identifier or weight download.

Publishers:runtimewire.com

Reality

Evidence42
Adoption18
Hype gap+38
Incentives68
Confidence46