Skip to content

Build Reports disagree7 publishers 3 min read Published Updated

Microsoft's Decision-1 turns the check before an agent acts into a scored Foundry call

Microsoft has put Decision-1, a model that scores fixed choices, in Foundry at $0.042 per million input tokens. Agent teams now have to test whether its scores, so far benchmarked only by Microsoft, are calibrated well enough to decide when a case goes to a human.

The Engineer · Build desk

Send a correction

Illustration accompanying Microsoft's Decision-1 turns the check before an agent acts into a scored Foundry call
Generated illustration
Decision-1's cost, input cap and Microsoft's tests List-price cost of one full-window check, the input limit, and Microsoft-reported benchmark and Xbox Research figures.

About $0.0014 at list price for one Decision-1 check that fills the full 32,768-token input window. Text inputs of up to 32,768 tokens. Microsoft's comparison covered 36 benchmarks. Xbox Research used it to sort more than 10,000 feedback items.

Decision-1's cost, input cap and Microsoft's tests
FigureValueNoteClaim
One check filling the full input window, about$0.0014 list price17
Text input, up to32,768 tokens4
In Microsoft's comparison36 benchmarks20
Xbox Research, more than10,000 feedback items10

What happened

  • Microsoft says the model had the highest accuracy in its own comparison of 36 benchmarks and nearly 150,000 questions, with the benchmarks kept blind from training.
  • Inside Microsoft, Xbox Research used it to sort more than 10,000 feedback items, and the Copilot team used it to assess AI responses.
  • The launch is led by Achint Srivastava, a Microsoft vice president who co-founded the AI evaluation startup Pi Labs with David Karam.

Why it matters

  • What it costs cost A check that fills the whole input window costs about a seventh of a cent, so most of the adoption cost is the labeled evaluation set each team must build from its own decisions.
  • Who's exposed exposure Teams that point it at employment, credit, housing, healthcare or legal-rights calls keep responsibility for thresholds and human review, because Microsoft's catalog says the model should not decide those alone.
  • Who has to decide decision Picking a Foundry-hosted scorer over Cloudflare's open-weight Clef ties escalation thresholds to Microsoft's endpoint until the undated OpenRouter access arrives, and moving later means recalibrating.

The interface is a closed question. An application sends a situation and the list of allowed answers, and Decision-1 sends back a probability for each one [2]. Input is text only, up to 32,768 tokens, and the response is JSON [4]. RuntimeWire's headline calls it a 9B model [3]. The supported formats are yes-or-no, multiple choice, ratings, rubric grading and relevance judgments, plus an explicit "cannot tell" option [5]. It does not write explanations or take open-ended questions, and it does not accept images, audio or video [6]. Srivastava's October 9 announcement lists its jobs as routing, classification, prioritization, verification and workflow control [8].

The "cannot tell" option is the best decision in the listing. A scorer that must split all its probability between "proceed" and "reject" has nowhere to put an input it does not understand. With an abstain choice available, escalation logic gets simple. RuntimeWire describes the pattern: an agent asks whether a proposed tool call meets a rubric, then proceeds, retries or escalates based on the score [14]. A team can send any case where "cannot tell" crosses a set level straight to a person.

Serial latency is the constraint behind the product. Agent checks are usually dependent, so step twelve waits on the verdict for step eleven. Microsoft's engineers give the figure in the announcement: 100 milliseconds added to each of 20 dependent decisions adds two seconds to a workflow [15]. Microsoft's median-latency figures put Decision-1 ahead of GPT-6 Sol by a factor of 35 and ahead of Quyet-1.0-Large by a factor of 4.5 [19]. A small scorer beating a general text generator on a task whose output is a few numbers is the expected direction of that result.

Input costs $0.042 per million tokens, and output is free [7]. Free output is an easy promise for a model that replies with a short list of probabilities. A check that fills the whole 32,768-token window costs about $0.0014 [17]. A thousand of those cost about $1.38 [18].

Across 36 benchmarks totaling nearly 150,000 questions, none of which the model saw in training, Microsoft says Decision-1 was the most accurate of the models it compared [20]. RuntimeWire notes that the announcement leaves out the full datasets and the latency test conditions, so outsiders cannot reproduce the comparison from it [21]. For the accuracy figure to carry over, a team's decisions have to resemble those benchmarks in their label sets, their prompt lengths and how often the right answer is actually ambiguous. For the latency multiples to carry over, the test's prompt sizes and concurrency have to look like production traffic.

Accuracy and calibration are separate properties. Accuracy counts how often the top choice is right. An escalation threshold needs a score of 0.8 on "proceed" to be right about 80 percent of the time on the team's own traffic. RuntimeWire frames the open question the same way: whether the score is dependable on customer-specific decisions, and calibrated well enough to set escalation thresholds safely [23]. A labeled sample of a team's own decisions, scored and plotted as predicted probability against observed outcome, answers that before any threshold ships.

Hosting is the other choice. Cloudflare introduced its Clef models on October 1 with open weights, deployed through Workers AI [12]. OpenAI's Decisions API is in public beta and returns typed answers to fixed questions [13]. Decision-1 starts in Foundry, and Microsoft says OpenRouter access is coming soon, without a date [22]. Thresholds tuned against one model's probabilities do not move to another model unchanged, so switching scorers means calibrating again. My context is a workflow already on Azure with a labeled eval set. There, I would trial Decision-1 first on support-ticket routing, one of the uses Microsoft names [9], because a misrouted ticket is cheap to reverse.

What to watch

  • Publication of the 36 benchmark datasets or the latency test conditions, which would let outside teams reproduce Microsoft's accuracy and 35x latency claims.
  • Calibration data for Decision-1, such as predicted-versus-observed curves on customer workloads, which is what escalation thresholds depend on.
  • A date for Decision-1 on OpenRouter, which would loosen the tie to Foundry hosting.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence38
Adoption
Not scored
Hype gap+30
Incentives65
Confidence62

Perspective Coverage

7 publishers
Builder
Builder 42%
Operator
Operator 28%
Investor
Investor 30%
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Microsoft has put Microsoft-Decision-1, a model that scores fixed choices instead of generating text, in Microsoft Foundry.

    Reported Supported Source: RuntimeWireView cited source
  2. [2]

    Given a situation and a defined set of choices, Decision-1 returns a probability for each option.

    Reported Supported Source: RuntimeWire, describing Srivastava's announcementView cited source
  3. [3]

    RuntimeWire's headline describes Decision-1 as a 9B decision model.

    Reported Supported Source: RuntimeWire headlineView cited source
  4. [4]

    Microsoft's Foundry listing says the model accepts text inputs of up to 32,768 tokens and returns JSON.

    Reported Supported Source: Microsoft Foundry listing, via RuntimeWireView cited source
  5. [5]

    Decision-1 supports yes-or-no questions, multiple choice, ratings, rubric grading, relevance judgments and an explicit "cannot tell" option.

    Reported Supported Source: Microsoft Foundry listing, via RuntimeWireView cited source
  6. [6]

    Decision-1 does not generate explanations, handle open-ended questions or accept images, audio or video.

    Reported Supported Source: Microsoft Foundry listing, via RuntimeWireView cited source
  7. [7]

    Microsoft lists Decision-1 input tokens at $0.042 per million, with output tokens free.

    Reported Supported Source: Microsoft, via RuntimeWireView cited source
  8. [8]

    In his October 9th announcement, Srivastava describes Decision-1 as a tool for routing, classification, prioritization, verification and workflow control.

    Reported Supported Source: Achint Srivastava, via RuntimeWireView cited source
  9. [9]

    Developers can use Decision-1 scores to route a support ticket, check an agent's proposed action, or send an uncertain case for human review.

    Reported Supported Source: RuntimeWire, describing Srivastava's announcementView cited source
  10. [10]

    Xbox Research used Decision-1 to sort more than 10,000 feedback items, and Copilot's team used it to assess AI responses; these results are Microsoft-reported.

    Reported Supported Source: Microsoft, via RuntimeWireView cited source
  11. [11]

    The Foundry catalog warns that Decision-1 should not be the sole automated decision-maker for consequential matters involving employment, credit, housing, healthcare or legal rights; integrating applications need to set thresholds, human review and safeguards.

    Reported Supported Source: Microsoft Foundry catalog, via RuntimeWireView cited source
  12. [12]

    Cloudflare introduced its Clef models on October 1st, with open weights and deployment through Workers AI.

    Reported Supported Source: RuntimeWireView cited source
  13. [13]

    OpenAI's Decisions API is in public beta, returning typed answers for fixed questions.

    Reported Supported Source: RuntimeWireView cited source
  14. [14]

    An agent can ask whether a proposed tool call meets a rubric, then proceed, retry or escalate based on the score.

    Reported Supported Source: RuntimeWireView cited source
  15. [15]

    Microsoft's engineers say in the announcement that adding 100 milliseconds to each of 20 dependent decisions adds two seconds to a workflow.

    Reported Supported Source: Microsoft engineers, via RuntimeWireView cited source
  16. [16]

    Achint Srivastava, a Microsoft vice president, co-founded AI evaluation startup Pi Labs with David Karam; Accel's profile lists Microsoft as Pi Labs' acquirer. The sources do not establish that Pi Labs' technology or team built Decision-1.

    Reported Supported Source: RuntimeWire, citing Accel's profileView cited source
  17. [17]

    A single Decision-1 check that fills the full 32,768-token input window costs about $0.0014 at list price.

    Derived Supported
  18. [18]

    One thousand maximum-length Decision-1 checks cost about $1.38 at list price.

    Derived Supported
  19. [19]

    Microsoft reports median latency 35 times faster than GPT-6 Sol and 4.5 times faster than Quyet-1.0-Large.

    Reported Contested Source: Microsoft, via RuntimeWireView cited source
  20. [20]

    Microsoft says Decision-1 had the highest accuracy in its comparison of 36 benchmarks and nearly 150,000 questions, with benchmarks kept blind from training.

    Reported Contested Source: Microsoft, via RuntimeWireView cited source
  21. [21]

    Microsoft's announcement does not provide the full datasets or latency test conditions needed to reproduce the comparison independently.

    Reported Contested Source: RuntimeWireView cited source
  22. [22]

    Microsoft plans to bring Decision-1 to OpenRouter; its announcement says OpenRouter access is coming soon, without giving a date.

    Reported Contested Source: Microsoft, via RuntimeWireView cited source
  23. [23]

    RuntimeWire says the greater operational question is whether the score is dependable on the customer-specific decisions developers need to automate, and whether it is calibrated well enough to set escalation thresholds safely.

    Reported Insufficient Source: RuntimeWireView cited source

Sources

7 independent publishers whose own reporting we read for this story.

  1. dev.to

    2 articles · October 12, 2026

    Microsoft-Decision-1 Scores the Choices an Agent Has to Make
  2. helpnetsecurity.com

    1 article · October 12, 2026

    Microsoft’s new model helps AI agents judge their next move
  3. implicator.ai

    1 article · October 11, 2026

    Microsoft Launches Decision-1 Amid Speed Comparison Dispute
  4. runtimewire.com

    1 article · October 9, 2026

    Microsoft puts a 9B decision model in Foundry for agent workflows
  5. testingcatalog.com

    1 article · October 9, 2026

    Microsoft launches Decision-1 model in Foundry
  6. the-decoder.com

    1 article · October 10, 2026

    Microsoft's Decision-1 model enters the fast-growing AI decision model race
  7. thenewstack.io

    1 article · October 10, 2026

    Microsoft skipped OpenAI’s decision model and built its own on Alibaba’s Qwen

Topics and entities

Topics

  • Agent controls and evaluation
  • Decision models
  • Model inference pricing and latency