The best grade for controlling in-house AI agents is a C+, and buyers can now cite it
Guidelight's first control assessment puts Anthropic and OpenAI at C+, Google at D+, xAI at D-, and Meta at F, using public evidence only. That is a baseline, not a lab's own account.
The Engineer · Build desk
What happened
- Guidelight AI Standards graded Anthropic, OpenAI, Google, xAI and Meta across six safeguards for AI systems used inside their own companies, in its first such assessment.
- Anthropic and OpenAI tied at the top with C+ grades, followed by Google at D+, xAI at D-, and Meta at F.
- Guidelight is a new independent nonprofit founded by Page Hedley and Steven Adler, two former OpenAI safety leaders. Hedley, the CEO, was previously OpenAI's policy and ethics adviser; Adler, chief scientist, worked at OpenAI from 2020 to 2024 and led teams including product safety and dangerous-capability evaluations.
- Guidelight drew only on public sources such as system cards, safety reports and blog posts.
- Guidelight selected six practices from its broader Control standard: logging internal AI activity, measuring whether monitors catch misbehavior, gating high-risk actions before they happen, halting systems after a burst of suspicious activity, commissioning outside reviews, and maintaining a containment plan for a model that tries to defeat its controls.
Why it matters
Guidelight AI Standards, a new independent nonprofit, has published the first outside grading of how frontier labs control the AI systems running inside their own companies [1]. The top grade was a C+ [2], which matters less as a verdict on any one lab than as a number a buyer can put next to a vendor's description of its own internal agent oversight.
The group scored Anthropic, OpenAI, Google, xAI and Meta on six practices drawn from its broader Control standard: logging internal AI activity, measuring whether monitors actually catch misbehavior, gating high-risk actions before they execute, halting systems after a burst of suspicious activity, commissioning outside reviews, and keeping a containment plan for a model that tries to defeat its controls [5]. Anthropic and OpenAI tied at C+, Google took a D+, xAI a D-, and Meta an F [2]. Scores ran from 0 for not implemented to 5 for full implementation, with 2 meaning limited partial implementation and 3 meaning substantial partial implementation; each practice counted equally [10].
The aggregate is thin. Across the five companies the average rating was 1.6 out of 5, 22 of the 30 individual ratings (73 percent) were a 2 or lower, seven were zeros, and no company earned a 4 or 5 on any practice; those totals are theneuron.ai's calculations from Guidelight's published scorecard [6]. An average of 1.6 is 32 percent of the available points [15]. Anthropic scored a 3 on five of six practices; OpenAI recorded three 3s and three 2s [11]. Since no rating exceeded 3 and 22 ratings were 2 or lower, there were eight 3s in total, and Anthropic's five plus OpenAI's three account for all of them, meaning Google, xAI and Meta did not clear a 2 anywhere [14].
Where progress exists, it is concentrated in detection rather than prevention. Anthropic and OpenAI both took 3s for logging and monitor efficacy, with Guidelight finding they log substantial portions of internal agent activity, scan it for suspicious behavior, and have done some work measuring how often the monitors catch what they should [12]. The pattern across all five is best at spotting misbehavior, worst at prevention and containment [7]. Google has published a detailed control roadmap [8].
Independent work points the same way. In a frontier-risk pilot earlier this year, the research group METR was given access to internal models and nonpublic information at Anthropic, Google, Meta and OpenAI, and found that automated monitors caught many harmful actions but also had coverage gaps and could be disabled or evaded, particularly when Anthropic let an embedded researcher red-team part of the system [9]. xAI is the one graded company not among METR's four participants [16].
The caveats are real and Guidelight states them. It is not a regulator, this is not an audit, the grading used only public material such as system cards, safety reports and blog posts, and the standards are living documents the group expects to revise [13][4]. It was founded by two former OpenAI safety leads, Page Hedley and Steven Adler, and Adler discloses that he still holds OpenAI equity [3][13].
For procurement, the six practices are the usable output: ask what fraction of agent activity is logged, what the measured monitor catch rate is, which actions are gated pre-execution, what trips a shutdown, who has reviewed it from outside, and what the containment plan says. Because the grades rest on public evidence [4], a vendor that thinks its score is unfair has an obvious remedy, which is exactly the disclosure a buyer wants.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence62
- Adoption31
- Hype gap+14
- Incentives58
- Confidence61
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Guidelight AI Standards graded Anthropic, OpenAI, Google, xAI and Meta across six safeguards for AI systems used inside their own companies, in its first such assessment.
- [2]
Anthropic and OpenAI tied at the top with C+ grades, followed by Google at D+, xAI at D-, and Meta at F.
- [3]
Guidelight is a new independent nonprofit founded by Page Hedley and Steven Adler, two former OpenAI safety leaders. Hedley, the CEO, was previously OpenAI's policy and ethics adviser; Adler, chief scientist, worked at OpenAI from 2020 to 2024 and led teams including product safety and dangerous-capability evaluations.
- [4]
Guidelight drew only on public sources such as system cards, safety reports and blog posts.
- [5]
Guidelight selected six practices from its broader Control standard: logging internal AI activity, measuring whether monitors catch misbehavior, gating high-risk actions before they happen, halting systems after a burst of suspicious activity, commissioning outside reviews, and maintaining a containment plan for a model that tries to defeat its controls.
- [6]
Across all five companies the average rating was 1.6 out of 5; 22 of the 30 individual ratings, or 73%, were a 2 or lower; seven received a zero; and no company earned a 4 or 5 on any practice. The publication states these are its own calculations from Guidelight's scorecard.
- [7]
The companies do best at spotting misbehavior and worst at prevention and containment.
- [8]
Google has published a detailed control roadmap.
- [9]
In a frontier-risk pilot conducted earlier this year, the independent research group METR received access to internal models and nonpublic information from Anthropic, Google, Meta and OpenAI. METR found that automated monitors caught many harmful actions, but also found gaps in coverage and ways monitors could be disabled or evaded, especially when Anthropic allowed an embedded researcher to red-team part of its system.
- [10]
The scoring system runs from 0 for not implemented to 5 for full implementation; a 2 means limited partial implementation and a 3 means substantial partial implementation. Each practice counted equally toward a company's overall grade.
- [11]
Anthropic received a 3 on five of the six practices; OpenAI earned three 3s and three 2s.
- [12]
Anthropic and OpenAI both received 3s for logging and monitor efficacy; Guidelight found the two log substantial portions of internal agent activity, scan that activity for suspicious behavior, and have done some work to measure how often the monitoring systems catch what they are supposed to catch.
- [13]
Guidelight is not a regulator and the assessment is not an official audit. The nonprofit says it accepts no funding from AI companies or their staff, although Adler discloses that he retains some OpenAI equity. Its standards are living documents it expects to revise.
- [14]
Because no rating exceeded 3 and 22 of the 30 ratings were 2 or lower, exactly eight ratings were 3s; Anthropic's five 3s and OpenAI's three 3s account for all eight, so Google, xAI and Meta received no rating above 2.
- [15]
An average rating of 1.6 out of 5 is 32 percent of the available points.
- [16]
xAI is the only one of the five graded companies not listed among the four labs that participated in METR's frontier-risk pilot.
Sources
2 independent publishers whose own reporting we read for this story.
- the-decoder.comAI labs are failing to keep their own systems in check
1 article · August 19, 2026
- theneuron.aiGuidelight’s First AI Control Grades Put Anthropic and OpenAI on Top
1 article · August 19, 2026
Topics and entities
Topics
- Frontier Lab Governance
- Third-Party AI Evaluation and Audit
- AI Incident Response and Containment
- Internal AI Agent Monitoring
- AI Control Standards
Entities
- Guidelight First Control Assessment
- OpenAI
- Steven Adler
- Guidelight AI Standards
- Meta
- METR
- Guidelight Control Standard
- Anthropic
- xAI