Skip to content

Company

Goodfire

Interpretability-focused AI company incorporated as a public-benefit corporation, working on reading and steering models' internal representations.

Known aliases

  • Goodfire AI
  • Goodfire lab

Current stories

leadershipConfirmed2 publishers

Ex-OpenAI researcher Cammarata argues AI neurons may be easier to interpret than long assumed

Independent researcher Nick Cammarata, who says he left OpenAI in 2023, published a report arguing almost the entire AI network is interpretable. Business Insider calls the findings still theoretical, so safety teams have a claim to test before they have an audit method.

Reality

Evidence38
Adoption
Not scored
Hype gap+35
Incentives
Not scored
Confidence55
buildConfirmed2 publishers

Goodfire's Nick Cammarata argues most neurons are legible, reinterpreting the superposition circuit from "Zoom In"

Goodfire's Nick Cammarata says the vast majority of neurons in models up to trillions of parameters are legible, reversing an explanation he helped shape. Google DeepMind's Neel Nanda warns against overhyping it, and the model-level numbers are preliminary.

Reality

Evidence35
Adoption
Not scored
Hype gap+30
Incentives50
Confidence60
scienceOne report1 publisher

Goodfire researcher argues InceptionV1's incoherent last layer came from architectural problems and weak interpretability tools, not superposition

Goodfire researcher says 99-100% of InceptionV1's last-layer neurons are easily interpretable after architecture changes. The essay argues the superposition evidence was misread, so networks can be studied directly.

Publishers:already-clean.goodfire.com

Reality

Evidence30
Adoption
Not scored
Hype gap+35
Incentives
Not scored
Confidence40
buildOne report1 publisher

Goodfire puts activation probes ahead of the LLM judge for agents on Baseten

Goodfire launched agent monitors on Baseten that it says watched about 1,500 Kimi K3 sessions for $51, against $233 for a model reviewing every step. Every figure so far comes from Goodfire's own tests, so operators still have to measure misses and false alarms on their own traffic.

Reality

Evidence40
Adoption15
Hype gap+25
Incentives65
Confidence55
investOne report1 publisher

Cyera's $1 billion Oasis deal puts a price on one of the AI risks in Anthropic's leaked S-1

Anthropic's leaked S-1 warns AI could resist shutdown or game tests, and only agent-control startups have found acquirers, Cyera paying $1 billion for Oasis. Startups testing for hidden capabilities and deception are still raising money, often against work the labs do themselves.

Publishers:cbinsights.com

Reality

Evidence35
Adoption35
Hype gap+10
Incentives55
Confidence35
buildOne report1 publisher

Steering 64 CLT features moves Gemma-2-2B through the ordered days at weaker token probabilities

A replication of Wurgaft et al.'s manifold steering on Anthropic's pre-trained CLT features reproduces the cyclical weekday transition in Gemma-2-2B. The author attributes the weaker push to the MLP sublayers holding only part of the signal.

Publishers:lesswrong.com

Reality

Evidence42
Adoption
Not scored
Hype gap−5
Incentives25
Confidence45
buildOne report1 publisher

Open-weight safety pact hints Baseten could test controls in its runtime, but no division of labor is confirmed

Base Labs has signed Hugging Face and Goodfire to publish methods for training, evaluating and monitoring open models, with the check running where the activations are. The partners have not published an evaluation suite yet.

Publishers:runtimewire.com

Reality

Evidence42
Adoption10
Hype gap+38
Incentives72
Confidence48
productOne report1 publisher

Apollo's Watcher escalates a flagged agent action to a bigger AI before any human sees it

The independent review of the Hugging Face incident needed AI to read its own evidence, and the startups selling AI monitors are building on that premise. Simon Willison says a watched model can try to fool its watcher.

Publishers:techcrunch.com

Reality

Evidence55
Adoption35
Hype gap+25
Incentives80
Confidence55