Skip to content

Topic

Decision models

Non-generative models that score or classify options and output probabilities, serving as a judgment layer alongside generative language models.

Current stories

buildOne report1 publisher

Subquadratic's SubQ Snap decision model reads 384K tokens in one request

Subquadratic's SubQ Snap decision model accepts 384,000 tokens per request, 12 times Jev's 32K limit, according to the company. CEO Alex Whedon says the cap reflects preview compute capacity. The accuracy and latency figures are Subquadratic's own.

Publishers:thenewstack.io

Reality

Evidence35
Adoption
Not scored
Hype gap+25
Incentives70
Confidence50
buildOne report1 publisher

Workday lets TypeSafe's Jev choose which design-system components Sana puts on screen

Workday gave TypeSafe's Jev every atomic component in its design system and lets the model pick what Sana shows, said chief AI officer Joel Hellermark. TypeSafe claims 70 to 500 milliseconds per answer; whether Workday sees that depends on how many screens reduce to closed questions.

Publishers:thenewstack.io

Reality

Evidence48
Adoption35
Hype gap+25
Incentives65
Confidence55
buildOne report1 publisher

Perplexity prices its open-weight decision model at a fifth of OpenAI's input rate

OpenAI, Microsoft and Perplexity launched decision-model APIs within nine days at $0.10, $0.042 and $0.02 per million input tokens. Perplexity's 27B weights are Apache 2.0, so a buyer with a roughly 49 GiB GPU can self-host v1.1.

Publishers:dev.to

Reality

Evidence35
Adoption
Not scored
Hype gap+20
Incentives
Not scored
Confidence40
buildOne report1 publisher

SubQ Snap charges about two cents to read a full 384K-token window

Subquadratic launched SubQ Snap at $0.05 per million input tokens with a 384K-token window, the sixth hosted decision model in about three weeks. No outside lab has run it, so every score in the launch is a claim about Subquadratic's own test set.

Publishers:dev.to

Reality

Evidence25
Adoption
Not scored
Hype gap+40
Incentives
Not scored
Confidence55
buildConfirmed7 publishers

Microsoft's Decision-1 turns the check before an agent acts into a scored Foundry call

Microsoft has put Decision-1, a model that scores fixed choices, in Foundry at $0.042 per million input tokens. Agent teams now have to test whether its scores, so far benchmarked only by Microsoft, are calibrated well enough to decide when a case goes to a human.

Perspective Coverage

7 publishers
Builder
Builder 42%
Operator
Operator 28%
Investor
Investor 30%

Reality

Evidence38
Adoption
Not scored
Hype gap+30
Incentives65
Confidence62
productOne report1 publisher

Microsoft releases a Qwen-based decision model that returns probabilities for fixed options

Microsoft released Microsoft-Decision-1, a small model that returns calibrated probabilities for fixed options, priced at $0.042 per million input tokens. The accuracy and speed figures are Microsoft's own, and the base model is due to change soon.

Publishers:thenextweb.com

Reality

Evidence35
Adoption
Not scored
Hype gap+15
Incentives70
Confidence60
buildConfirmed2 publishers

Cloudflare's Clef-omni scores audio and video against a decision schema in one call

Cloudflare's Clef-omni takes audio and video alongside text and images and returns schema-bound decisions in one API call. Runtimewire reported that the same release cut hosted Clef-flash's context window from 64,000 to 24,000 tokens, so longer prompts now go to Clef or to self-hosted weights.

Perspective Coverage

3 publishers
Builder
Builder 63%
Operator
Operator 25%
Investor
Investor 12%

Reality

Evidence55
Adoption12
Hype gap+30
Incentives70
Confidence60
buildConfirmed2 publishers

Liquid's d1-3B returns structured decisions in one forward pass at 16 ms on Jetson Thor

Liquid AI's open-weight d1-3B answers classification questions in a single forward pass, taking 16 ms on a Jetson AGX Thor and 50 ms on an Orin Nano. That puts routing and intent tagging on edge boards without a large model, on figures Liquid measured itself.

Perspective Coverage

3 publishers
Builder
Builder 55%
Operator
Operator 30%
Investor
Investor 15%

Reality

Evidence50
Adoption
Not scored
Hype gap+20
Incentives70
Confidence60
buildOne report1 publisher

AWS, Upstage and Ollama adopt TypeSafe's System One schema for decision models

AWS, Upstage and Ollama now serve decision models through TypeSafe's System One request format, within three weeks of TypeSafe launching Jev. OpenAI has not signed on, so teams wiring decision calls into agents are picking an interface while the standard is still forming.

Publishers:thenewstack.io

Reality

Evidence55
Adoption45
Hype gap+15
Incentives
Not scored
Confidence50
buildConfirmed4 publishers

OpenAI splits classification into a Decisions API priced at 10 cents per million input tokens

OpenAI's Decisions API answers yes/no, pick-one and scale questions for $0.10 per million input tokens, with output free. Jev sells the same three question types for text at less than half that, so OpenAI's case rests on image input and compliance terms.

Perspective Coverage

4 publishers
Builder
Builder 59%
Operator
Operator 24%
Investor
Investor 17%

Reality

Evidence62
Adoption20
Hype gap+15
Incentives45
Confidence60
buildOne report1 publisher

Ollama and llama.cpp now serve Jev-spec decision models on local hardware

Ollama and llama.cpp added local endpoints within a week for Jev decision models, 144M-to-27B checkpoints that return a label and a probability. Routing calls can move off hosted models once teams check each checkpoint's licence and test it on their own labels.

Publishers:dev.to

Reality

Evidence35
Adoption25
Hype gap+15
Incentives40
Confidence30
buildConfirmed2 publishers

Musubi's open PolicyLM-1.7B reads a platform's moderation rules at inference time

Musubi released PolicyLM-1.7B under Apache-2.0 to score messages against a written policy in a reported 22 milliseconds on an H100. Teams can rewrite rules without retraining, though every speed and accuracy figure so far comes from Musubi's own tests.

Perspective Coverage

3 publishers
Builder
Builder 38%
Operator
Operator 37%
Investor
Investor 25%

Reality

Evidence45
Adoption10
Hype gap+25
Incentives70
Confidence60
buildConfirmed4 publishers

Typesafe's Jev API gains an open-weight rival in Cloudflare's Clef decision models

Cloudflare released two Jev-API-compatible decision models, Clef and Clef-flash, on Workers AI and as Apache 2.0 weights on Hugging Face. Typed classification steps in agent code can now move between providers or onto owned hardware, as long as they stay inside the text-only, 32k-context features Jev supports.

Publishers:blog.cloudflare.com dev.to developers.cloudflare.com the-decoder.com

Perspective Coverage

4 publishers
Builder
Builder 53%
Operator
Operator 30%
Investor
Investor 17%

Reality

Evidence55
Adoption18
Hype gap+30
Incentives75
Confidence60
buildOne report1 publisher

OpenAI and AWS reportedly answer Jev with decision models of their own within two weeks

OpenAI and AWS shipped their own decision models within two weeks of TypeSafe AI's September 15 launch of Jev, according to a dev.to account. For routing work, the comparison with an LLM call turns on whether a decision model's probabilities are calibrated.

Publishers:dev.to

Reality

Evidence30
Adoption25
Hype gap+35
Incentives55
Confidence35
productConfirmed3 publishers

AWS open-sources Strands Decider 2B to make agent routing decisions on a laptop

AWS open-sourced Strands Decider 2B, a model that picks from a fixed list of options in under 150 milliseconds on a local machine, the company says. Agent builders get a small model they can run themselves for routing and tool-selection steps that would otherwise each call a full LLM.

Perspective Coverage

3 publishers
Builder
Builder 48%
Operator
Operator 25%
Investor
Investor 27%

Reality

Evidence58
Adoption
Not scored
Hype gap+22
Incentives60
Confidence62
buildConfirmed3 publishers

llama.cpp brings TypeSafe's typed-decision format to five open model families on local hardware

llama.cpp merged a /v1/systemone endpoint on October 2 that returns typed answers with probabilities from five open model families running locally. Whether it can replace hosted classification calls depends on calibration that each team has to measure on its own data.

Perspective Coverage

3 publishers
Builder
Builder 48%
Operator
Operator 29%
Investor
Investor 23%

Reality

Evidence50
Adoption15
Hype gap+5
Incentives55
Confidence55
leadershipOne report1 publisher

TypeSafe AI's Jev puts routine decisions on the automation agenda

TypeSafe AI's Jev, a model that returns scored decisions, is in some developers' products after a launch video drew almost 40 million views on X. The evidence so far is hackathon testimony, so the useful work for leaders this quarter is finding which routine decisions can be split into narrow questions.

Reality

Evidence30
Adoption20
Hype gap+45
Incentives60
Confidence35
buildOne report1 publisher

Ollaya's latency table sets a local RTX 4090 against Jev's network round trip

Mert Cobanov's open-source Ollaya serves local decision models behind a Jev-compatible API and reports 8 to 10 ms per request on an RTX 4090. Its comparisons with TypeSafe's hosted service are uncontrolled, so teams have to check accuracy on their own traffic before switching.

Publishers:runtimewire.com

Reality

Evidence38
Adoption
Not scored
Hype gap+25
Incentives60
Confidence35
buildConfirmed14 publishers

Jev turns a catalogue ID from a prompt constraint into part of the decision domain

TypeSafe's Jev answers typed questions with floats and probabilities. An invoice pipeline that handed it classification and catalogue selection still needs a generative model for field extraction and for the note a human reads.

Perspective Coverage

14 publishers
Builder
Builder 53%
Operator
Operator 31%
Investor
Investor 16%

Reality

Evidence55
Adoption40
Hype gap+30
Incentives65
Confidence55

Earlier coverage