California prices negligent child harm at up to $1m per child
Gavin Newsom signed a package on Thursday that bans autoplay and history-based feeds for under-16s and requires companion chatbots to alert parents when a young user shows distress. Penalties are counted per child.
The Board Room · Leadership desk
What happened
- The package bans autoplay scrolling and algorithmic feeds based on user history for people under 16, with AB 1709 carrying the infinite scroll and autoplay restriction.
- Companies running AI chatbots must enact crisis protocols that notify parents when young users show signs of emotional distress.
- The new regulations extend California's child sexual exploitation laws to cover digitally altered and AI-generated sexual imagery of minors.
- Newsom signed separate laws on Wednesday, supported by Anthropic, requiring state rules for independent evaluators of AI model safety risks and a registry of financially independent AI auditors.
Why it matters
- What it costs cost Counting by the child turns a ranking default into a variable legal cost that scales with cohort size: at the statutory ceiling, one finding covering a thousand California minors is a billion dollars against reserves.
- What it limits constraint Both the under-16 feed rules and the chatbot notification duty depend on knowing which account belongs to a minor, and the published accounts specify no method, so cohort identification is the schedule risk, and its timeline is still open.
- What doesn't add up contradiction Meta says personalization is how it delivers age-appropriate content to teens; the EFF says stripping those tools cuts minors off from speech. Two opposed complaints describe one product change.
- Who has to decide decision Chatbot teams now have to set a distress threshold and decide what a parent is told, because for the first time the duty runs to someone outside the account.
Next story · Invest · yesterday
Scientists ask AI labs to unplug cyber-capable models and log every escapeConfirmed2 publishers
CBS reports the package penalizes large social media companies up to $1 million per child where they are found negligent of harming children through their platforms [7]. At that ceiling, a finding covering a thousand minors comes to $1 billion [20]. For scale, the up-to-$18 billion child-safety settlement CBS reports from last month, reached with 28 other states after a 2023 lawsuit alleging a tech company deliberately designed features to addict children, is 18,000 children at California's per-child cap [13][21]. Both figures are ceilings, and the California one attaches only where negligence is found [7].
The timing is the open question. Neither account of the signing gives an effective date for the feed rules or the chatbot duty [22]. The published accounts also skip how a platform must establish which users are under 16 [23]. A team can begin the cohort work this quarter without a compliance date to build toward. That determination is the load-bearing engineering: AB 1709's ban on infinite scroll and autoplay applies to users under 16 [4], and the chatbot crisis protocol is triggered by young users showing signs of emotional distress [8].
"This is about actually addressing the problem, the scrolling, the algorithms. This is about addressing the substantive issue around the engineering," Newsom said [3]. The objections arrive from opposite directions and describe the same product change. Meta raised concerns about some of the bills, saying the restriction on addictive feeds hinders its ability to bring enjoyable content to users on its platforms [11]. "Personalization is also how we deliver age-appropriate content for teens that is relevant to them," spokesperson Jim Cullinan said in a statement [12]. The Electronic Frontier Foundation reads AB 1709 as a "functional ban on social media use" for users under 16 [5]. "California should be passing laws to ensure that technology really works for people of all ages, not enacting social media bans that cut young people off from digital lifelines, communities, and speech," said Rindala Alajaji, the group's associate director of state affairs [6]. Either way, the mechanics are the same: for under-16 accounts, ranking on a user's own history goes away [2].
The record does not report a filed challenge to that design mandate, and the EFF's language is a preview of an argument [5]. The chatbot obligation also sits on different ground. It requires an operator to notify a parent when a young user shows signs of distress [8]. The work there is escalation design: detection thresholds, who gets paged, and what the parent is told.
One of the chatbot measures was inspired by the death of Adam Raine, whose mother said he died because he was "coached" by a chatbot [16]. "Adam was an early adopter of AI, and so many of us parents did not understand the dangers back then," Maria Raine said at a news conference [17]. The governor's office says California now has the "strongest companion chatbot regulations" in the United States [9].
The direction of travel is legible in what Newsom has already signed and refused. Last year he signed a law requiring platforms to remind users they are interacting with a chatbot and not a human [14]. Hours later he vetoed a bill that would have banned companies from making AI chatbots available to anyone under 18 unless they could ensure the technology could not engage in sexual conversations or encourage self-harm [15]. Thursday's laws leave the products available to minors and attach duties to how those products behave [2][8].
What to watch
- Effective dates and implementing rules: the accounts of the signing give no compliance deadline for the feed restrictions or the chatbot protocols.
- Whether anyone files the speech challenge the EFF's framing sketches, and whether a court reaches AB 1709 before platforms rebuild under-16 feeds.
- New York's parental block on algorithmic suggestions is scheduled to take effect early next year, a nearer test of the same mechanism.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence58
- Adoption
- Not scored
- Hype gap+28
- Incentives74
- Confidence61
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
California Gov. Gavin Newsom signed laws on Thursday to protect children from the risks of technology, including social media and AI chatbots.
- [2]
The legislation bans autoplay scrolling for users under 16 and algorithmic feeds based on user history.
- [3]
Newsom said: "This is about actually addressing the problem, the scrolling, the algorithms. This is about addressing the substantive issue around the engineering."
- [4]
AB 1709 bars social media companies from using infinite scroll and autoplay for users under 16.
- [5]
The Electronic Frontier Foundation argues that AB 1709 is a "functional ban on social media use" for users under 16.
- [6]
Rindala Alajaji, the EFF associate director of state affairs, said in a statement: "California should be passing laws to ensure that technology really works for people of all ages, not enacting social media bans that cut young people off from digital lifelines, communities, and speech."
- [7]
The laws will penalize large social media companies up to $1 million per child if they are found negligent of harming children through their platforms.
- [8]
For AI chatbots, tech companies must enact crisis protocols to notify parents if young users show signs of emotional distress.
- [9]
According to the governor's office, California now has the "strongest companion chatbot regulations" in the US.
- [10]
The new regulations update child sexual exploitation laws to include "digitally altered and AI-generated" sexual imagery of minors.
- [11]
Meta raised concerns about some of the bills, saying the law to restrict addictive feeds hinders the company's ability to bring enjoyable content to users on its platforms.
- [12]
Meta spokesperson Jim Cullinan said in a statement: "Personalization is also how we deliver age-appropriate content for teens that is relevant to them".
- [13]
CBS reports a settlement last month with 28 other states after they alleged in a 2023 lawsuit that a tech company deliberately designed features to addict children; the company agreed to pay up to $18 billion and strengthen its child safety measures. The excerpt does not name the company in that passage.
- [14]
Newsom signed a law last year requiring platforms to remind users they are interacting with a chatbot and not a human.
- [15]
Hours after signing the chatbot disclosure law, Newsom vetoed a bill that would have banned companies from making AI chatbots available to anyone under 18 years old unless the businesses could ensure the technology couldn't engage in sexual conversations or encourage self-harm.
- [16]
Maria Raine, a mother whose teenage son Adam died by suicide last year, said he died because he was "coached" by a chatbot; one of the laws Newsom signed, requiring chatbot operators to implement certain child safety measures, was inspired by Adam's story.
- [17]
Maria Raine said at a news conference: "Adam was an early adopter of AI, and so many of us parents did not understand the dangers back then."
- [18]
Newsom also signed laws on Wednesday, supported by Anthropic, aimed at improving oversight of AI companies: one requires the state to create rules for independent organizations to evaluate the safety risks of AI models, and the other requires the state to create a registry of AI auditors, who would have to be financially independent.
- [19]
Two years ago New York approved a law allowing parents to block their children from getting social media posts suggested by a platform's algorithm, and the policy is scheduled to go into effect early next year.
- [20]
At the $1 million per-child ceiling, a negligence finding covering 1,000 minors totals $1 billion.
- [21]
The up-to-$18 billion settlement CBS reports is equivalent to 18,000 children at California's $1 million per-child ceiling.
- [22]
Neither published account of the signing gives an effective date for the under-16 feed restrictions or for the chatbot crisis-protocol duty.
- [23]
Neither published account describes how platforms must establish which users are under 16.
Sources
2 independent publishers whose own reporting we read for this story.
- cbsnews.comNewsom signs new laws to protect kids from social media and AI chatbots - CBS San Francisco
1 article · September 10, 2026
- theguardian.comGavin Newsom signs bill regulating AI, social media and chatbots for children | Social media | The Guardian
1 article · September 10, 2026
Topics and entities
Topics
- Recommendation Algorithms
- US State Tech Policy
- Child Online Safety
- Companion Chatbots
- AI Regulation
Entities
- Assembly Bill 1709
- Electronic Frontier Foundation
- Meta
- Gavin Newsom
- Anthropic
- California