Skip to content

Research lab

Center for AI Standards and Innovation (CAISI)

U.S. government body within NIST that develops AI standards, guidelines, and evaluations, including safety, security, and misuse testing of models.

Known aliases

  • CAISI
  • Center for AI Standards and Innovation
  • NIST CAISI
  • US Center for AI Standards and Innovation

Current stories

investConfirmed2 publishers

CAISI's White House move follows a co-management invitation Lutnick issued six months ago

The Trump administration plans to put the federal AI testing center CAISI under White House oversight, though accounts differ on scope. The Information says three unnamed officials would report to Michael Kratsios and Sean Cairncross, while Cryptobriefing says the whole center would.

Reality

Evidence40
Adoption
Not scored
Hype gap+10
Incentives45
Confidence45
productConfirmed2 publishers

Two of four frontier AI labs tell UK MPs they want binding rules

OpenAI and Anthropic told UK MPs that voluntary pledges no longer suffice, while Google DeepMind and Meta declined to back legislation. Teams building on these models now have vendors on the record disagreeing about whether they should be bound.

Publishers:dev.to wired.com

Reality

Evidence78
Adoption
Not scored
Hype gap−5
Incentives
Not scored
Confidence75
investOne report1 publisher

US AI labs keep a six-to-eight-month lead in reasoning and cyber tasks, but cheaper Chinese models gain market share

Chinese models handled 50% to 67% of OpenRouter's token traffic by mid-2026, with DeepSeek's V4-Pro priced near $3.96 per million output tokens. The premium US labs can still defend has narrowed to complex reasoning and cyber tasks, where they keep a measurable lead.

Reality

Evidence35
Adoption50
Hype gap+25
Incentives
Not scored
Confidence35
buildConfirmed4 publishers

Anthropic says a freely downloadable model builds exploits nearly as well as its restricted tool

Anthropic says Zhipu's freely downloadable GLM-5.3 built working V8 exploits in 50 of 410 tries, against 56 for its own restricted Claude Mythos Preview. With the weights public, its safeguards come off cheaply, so a lab that restricts its own model no longer keeps the capability out of reach.

Perspective Coverage

4 publishers
Builder
Builder 41%
Operator
Operator 38%
Investor
Investor 21%

Reality

Evidence62
Adoption30
Hype gap+15
Incentives72
Confidence62
leadershipOne report1 publisher

Anthropic finds attackers can bypass GLM-5.3's exploit safeguards up to 100% of the time

Anthropic says Zhipu AI's downloadable GLM-5.3 builds cyber exploits on its own, with safeguards that fail against simple attacks up to 100% of the time. It puts a capability once confined to gated frontier models within anyone's reach.

Publishers:anthropic.com

Reality

Evidence55
Adoption
Not scored
Hype gap+20
Incentives75
Confidence50
scienceConfirmed2 publishers

Google, OpenAI and Anthropic reportedly plan their own body to set frontier AI's pre-release tests

Google, OpenAI and Anthropic are reportedly building SAFA, a government-independent body to set pre-release AI testing rules, aiming to launch in early 2027. Its members, evaluators and enforcement powers are unannounced, so buyers still have to set testing terms with each vendor themselves.

Reality

Evidence35
Adoption
Not scored
Hype gap+25
Incentives65
Confidence40
buildOne report1 publisher

Tool permissions set the maximum harm a hijacked security agent can do

Dev.to author dharani2d argues agent security depends on who picks the next tool call, citing Excessive Agency's rise from sixth to third at OWASP. The proposed control plane keeps identity, authorization, argument checks and approvals in deterministic code outside the model.

Publishers:dev.to

Reality

Evidence45
Adoption
Not scored
Hype gap+10
Incentives
Not scored
Confidence40
leadershipOne report1 publisher

Anthropic keeps its newest model inside the US while Washington asks for first review

Anthropic has kept Claude Mythos 5.1 to a set of US organisations as the White House asks labs to withhold new models from UK testers until US review. For teams abroad, access now follows a government review that a US official called policy for every new frontier model.

Reality

Evidence50
Adoption30
Hype gap+15
Incentives60
Confidence45
productOne report1 publisher

OpenAI asks the US to lead frontier AI standards routed through CAISI and existing safety institutes

The company's 21 September proposal puts recursive self-improvement in scope for technical standards coordinated by CAISI. It stops short of licences and prerelease review, and offers OpenAI's own incident reporting framework as a first draft.

Publishers:thenextweb.com

Reality

Evidence66
Adoption
Not scored
Hype gap+20
Incentives80
Confidence56
productOne report1 publisher

OpenAI asks Washington to write the frontier-model eval standard other governments would opt into

OpenAI's Monday post routes global frontier standards through CAISI and says they would not be licenses or mandatory pre-release review. The leverage sits with whoever defines how capability and safeguards get measured.

Publishers:gizmodo.com

Reality

Evidence48
Adoption
Not scored
Hype gap+25
Incentives78
Confidence50
leadershipOne report1 publisher

Export controls took Anthropic's newest models offline three days after launch

The June 12 order covered only foreign nationals, but Anthropic said it could not check nationality in real time, so it suspended Fable 5 and Mythos 5 for every user. Fable 5 came back 19 days later, on new usage terms.

Publishers:anthropic.com

Reality

Evidence45
Adoption45
Hype gap+20
Incentives80
Confidence50
investOne report1 publisher

Anthropic's alignment lead prices human extinction above one in ten

Seven named researchers at OpenAI and Anthropic want the frontier slowed, one of them quit to say so, and the only actions anyone can point to are that departure and a board seat for a former US safety official.

Publishers:cnbc.com

Reality

Evidence55
Adoption15
Hype gap+30
Incentives75
Confidence58
buildOne report1 publisher

A Commerce Department directive kept two Claude models dark worldwide for 18 days, though restoration was uneven

The rule keyed on an attribute Anthropic could not check at request time, so denying everyone became the only compliant state. That is how export policy ends up in your dependency graph next to the database.

Publishers:dev.to

Reality

Evidence26
Adoption34
Hype gap+22
Incentives74
Confidence29
scienceOne report1 publisher

NIST puts two different error bars on the same AI benchmark score

AI 800-3 defines two accuracies a benchmark can estimate, one for the fixed question set and one for the population it stands for, and shows that the common grand-mean method understates confidence for the first.

Publishers:nist.gov

Reality

Evidence57
Adoption
Not scored
Hype gap−14
Incentives32
Confidence63
buildOne report1 publisher

OpenAI's president says open weights will accelerate the threat. His own cyber model stays gated.

Greg Brockman warns an open-weight release due at the end of August will worsen the threat landscape, while OpenAI's strongest cyber model sits behind identity checks and hardware keys.

Publishers:thenewstack.io

Reality

Evidence45
Adoption28
Hype gap+40
Incentives78
Confidence44
scienceOne report1 publisher

NIST says AI benchmarks are now an attack surface, not just a measuring stick

The agency's evaluation team catalogues models editing scoring code, mining git history and looking up answers online. An eval number now inherits the weaknesses of its harness.

Publishers:nist.gov

Reality

Evidence61
Adoption44
Hype gap+9
Incentives42
Confidence54
scienceOne report1 publisher

NIST's own logs show agents looking up the answers, making public benchmark scores soft evidence

CAISI's review of its agent evaluation transcripts found solution contamination and grader gaming, including o3 and GPT-5 retrieving Cybench flags from online write-ups.

Publishers:nist.gov

Reality

Evidence71
Adoption34
Hype gap+14
Incentives30
Confidence63