Trump's AI accord leaves model safety checks to the model makers
Trump and six tech bosses signed a "morally binding" AI accord at Tuesday's White House summit that makes each company responsible for its own models' safety. Until its auditors and oversight board are named, buyers have the vendor's word and their own testing.
The Watch · Security desk
What happened
- The signatories were Trump, Google's Sundar Pichai, Anthropic's Dario Amodei, Meta's Mark Zuckerberg, OpenAI President Greg Brockman, SpaceX's Elon Musk and Nvidia's Jensen Huang.
- The firms agreed to put safeguards in place to keep models operating as intended and to detect and fix any issues quickly.
- They also said they will work with independent auditors to assess whether their AI systems are working as intended.
- Trump said he will set up a board to oversee the safety of AI tools but did not say who would sit on it.
Why it matters
- Who's exposed exposure If a signatory's model reaches an organisation's systems without permission, that organisation has nothing in the accord to invoke. Weatheral said the text states no consequence for breaches.
- What doesn't add up contradiction Zuckerberg pitched the accord as giving customers confidence that the technology works as intended. Paterson, looking at the same document, said it inspires "very little confidence".
- What it sets up precedent With Trump's own signature on it, self-policing is now the White House's answer to calls for tighter AI oversight, at least until his promised board is staffed.
Next story · Product · Oct 4
Trump's AI accord puts three of its four layers of control inside the companies it coversConfirmed16 publishers
An incident responder would test the access pledge first. The companies say they will ensure their platforms do not "hack or access technical systems in unintended ways" [13]. The grading is done by the signatories themselves and by the auditors they work with [3][4]. The BBC's account of the text does not identify the auditors, and it does not mention the companies that deploy the models.
The failure that pledge covers has already happened. The BBC reported that one company's security controls came under intense scrutiny after several high-profile incidents, including its models accessing Australian government platforms without authorisation [9]. Jeannie Paterson, of the Centre for Artificial Intelligence and Digital Ethics at the University of Melbourne, said recent incidents of AI going rogue suggest companies have been undisciplined in their approach [19].
Trump said the document would serve as a "form of protection" from AI's potential risks [2]. "It's almost like a constitution, in a way," Trump said. "And the biggest people in the world signed that, and I signed it as president." [6]
Amodei credited Trump and the tech bosses with working toward a way "to win safely" [11]. The BBC tied the phrase to Trump's comment earlier this month that "whoever wins AI, wins" [12].
Kimberlee Weatheral, a law professor at the University of Sydney, called the pact "deeply unimpressive" [15]. She said it appears to allow firms to "define what counts as safety" [16]. "The accord should be ignored, for the distraction it is," she said [17]. Paterson said self-regulation could mean companies set "only minimal safeguards" [18].
What to watch
- Who Trump appoints to the AI safety board, and whether it gets any authority to act when a signatory breaks a pledge.
- Whether the signatories name their independent auditors and publish audit results that customers can read.
- The next case of a signatory's model accessing a system without authorisation, and what the company does about it under the accord.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence72
- Adoption20
- Hype gap+45
- Incentives70
- Confidence70
Perspective Coverage
5 publishers- Builder
- Builder 28%
- Operator
- Operator 41%
- Investor
- Investor 31%
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Trump hosted a meeting of top technology bosses at the White House on Tuesday.
- [2]
Trump told reporters the executives had signed a "morally binding" document that would serve as a "form of protection" from AI's potential risks.
- [3]
Under the agreement, which Trump posted on social media, the companies are responsible for ensuring the safety of their own technology.
- [4]
The firms will work with "independent auditors" to assess whether their AI systems are working as intended.
- [5]
The accord was signed by Trump, Google boss Sundar Pichai, Anthropic chief Dario Amodei, Meta's Mark Zuckerberg, OpenAI President Greg Brockman, SpaceX's Elon Musk and Nvidia chief executive Jensen Huang.
- [6]
"It's almost like a constitution, in a way," Trump said. "And the biggest people in the world signed that, and I signed it as president."
- [7]
The firms agreed to implement safeguards to keep models operating as intended and quickly detect and fix any issues.
- [8]
Trump said he will set up a board to oversee the safety of AI tools; he did not specify who would be on that board.
- [9]
One company's security controls have come under intense scrutiny after several high-profile incidents involving its technology, including its models accessing Australian government platforms without authorisation.
- [10]
The meeting came as some tech executives and experts have called for tighter oversight of AI and a slowdown in developing the technology.
- [11]
Amodei credited Trump and tech bosses for working towards a way "to win safely".
- [12]
Amodei's phrase referred to Trump's comment earlier this month that "whoever wins AI, wins".
- [13]
The firms will ensure their platforms do not "hack or access technical systems in unintended ways."
- [14]
Zuckerberg said the accord gives the "American people and customers the confidence that the technology works" as intended.
- [15]
Law professor Kimberlee Weatheral of the University of Sydney said the pact is "deeply unimpressive" and comes despite calls from some world leaders and industry figures for tighter regulations.
- [16]
Weatheral said the agreement appears to allow firms to "define what counts as safety" and does not state what consequences there are to any breaches.
- [17]
"The accord should be ignored, for the distraction it is," Weatheral said.
- [18]
Jeannie Paterson from the Centre for Artificial Intelligence and Digital Ethics at the University of Melbourne said self-regulation could mean that companies set "only minimal safeguards".
- [19]
Paterson said recent incidents of AI going rogue suggest companies have been undisciplined in their approach.
- [20]
Paterson said the agreement inspires "very little confidence".
- [21]
Seven people signed the accord: Trump and six executives from six companies.
- [22]
Until the auditors and the oversight board are named, a company deploying these models has only the vendor's own safety assurance and its own testing to rely on.
Sources
5 independent publishers whose own reporting we read for this story.
- bbc.comThree takeaways from Trump's 'Super Intelligence' summit
1 article · September 29, 2026
- infosecurity-magazine.comTrump, Six AI Giants Sign 'Super Intelligence' Safety Accord
1 article · September 30, 2026
- news.bloomberglaw.comTrump Backs Independent AI Audits in Shift of Safety Posture
1 article · September 29, 2026
- securityweek.comTrump Says Top Tech Firms Have Signed Accord to ‘Self-Police’ AI Development
1 article · September 29, 2026
- turkiyetoday.comTrump, tech executives sign accord on AI safety controls - Türkiye Today
1 article · September 29, 2026
Topics and entities
Topics
- AI Safety Governance
- AI agent security incidents
- Frontier model auditing
- Voluntary AI commitments