Skip to content

Research lab

GovAI

Research organization studying AI governance, focusing on policy, safety and risk-mitigation strategies for advanced artificial intelligence systems.

Known aliases

  • Center for the Governance of AI
  • Centre for the Governance of AI

Current stories

investOne report1 publisher

OpenAI and Anthropic models hacked five companies during internal testing

GovAI's Alan Chan says labs' published safety tests may not reflect internal use, where models with safeguards off hacked at least four companies. The independent audits he favors need technical staff that, by his account, the field does not yet have.

Publishers:fortune.com

Reality

Evidence55
Adoption
Not scored
Hype gap+10
Incentives40
Confidence50
leadershipOne report1 publisher

AGI claims from Brockman, Huang and Musk rest on a term even Anthropic's chief calls marketing

Five tech executives, including OpenAI's Greg Brockman, have said artificial general intelligence is already here. One of the term's earliest users calls it marketing, and the skill he says AI still lacks, learning a new job quickly, is the one a staffing plan rests on.

Reality

Evidence50
Adoption
Not scored
Hype gap+65
Incentives70
Confidence45
leadershipConfirmed3 publishers

Frontier lab scientists ask governments to put auditors inside their own companies

Twenty-two authors, including chief scientists from OpenAI, Anthropic, Microsoft and Meta, asked governments in a Sept. 28 paper to require reporting on how far labs have automated their research and to embed independent auditors inside some firms.

Perspective Coverage

3 publishers
Builder
Builder 23%
Operator
Operator 42%
Investor
Investor 35%

Reality

Evidence60
Adoption15
Hype gap+25
Incentives55
Confidence60
productConfirmed2 publishers

A formatting prompt carried an AI hallucination across US command channels

CNN reports that a Special Operations Command analyst used a chatbot to fuse open-source and classified signals intelligence, then used it again to turn the wrong answer into the summary that moved up the chain.

Perspective Coverage

7 publishers
Builder
Builder 33%
Operator
Operator 51%
Investor
Investor 16%

Reality

Evidence42
Adoption48
Hype gap+25
Incentives60
Confidence45
productOne report1 publisher

Chinese officials dismiss Amodei's proposed AI slowdown as fear-mongering

Anthropic's chief executive asked the industry to slow its most powerful models and said the pause needs China's cooperation. Beijing's foreign ministry called the idea fear-mongering three days before its own standards body warned about recursive self-improvement.

Publishers:restofworld.org

Reality

Evidence68
Adoption15
Hype gap+20
Incentives80
Confidence60
investConfirmed6 publishers

Industry-run AI standards body debated as Hassabis's 30-day evaluation window emerges as one proposal

Anthropic, OpenAI and Google have had working groups meeting since July on a safety standards body they would run themselves, after the White House route stalled. The only cost anyone has published is a 30-day review.

Perspective Coverage

6 publishers
Builder
Builder 28%
Operator
Operator 33%
Investor
Investor 39%

Reality

Evidence62
Adoption28
Hype gap+34
Incentives78
Confidence66
investOne report1 publisher

Daily filing caps miss the 34 AI-flooding cases where only the documents got longer

A new study traces 87 per cent of documented demand surges at government services to one capability, cheaply produced text, and its authors say 84 cases prove existence without measuring how widespread the flooding has become.

Reality

Evidence42
Adoption38
Hype gap+28
Incentives55
Confidence40
productOne report1 publisher

The White House named 12 AI subfields. Open weights was not one of them.

A 24-page national security science strategy calls brain-computer interfaces and digital assets critical technologies. Open weights and open-source development appear nowhere in it.

Publishers:thenextweb.com

Reality

Evidence64
Adoption27
Hype gap+24
Incentives58
Confidence56