Skip to content

Topic

Trust and Safety

The discipline within tech platforms devoted to detecting and curbing abuse, harassment, exploitation, and other harmful content or behavior among users.

Current stories

securityOne report1 publisher

Joint Economic Committee finds Tinder's median scammer profile views rose over 700 percent

Congress's Joint Economic Committee found nearly 1.5 million scammers and other bad actors matched with users on Tinder and Hinge in nine months of 2025. Match Group says the report mischaracterizes its safety work.

Publishers:therecord.media

Reality

Evidence55
Adoption50
Hype gap+10
Incentives60
Confidence58
productOne report1 publisher

Hinge's India screenshot block covers the profile screens women use to vet dates

Hinge is testing screenshot blocking in India on profile screens including Discover, Likes You and Standouts. Reactions Wired gathered split between relief at fewer profile dunks and worry for women who vet matches with friends.

Publishers:wired.com

Reality

Evidence55
Adoption12
Hype gap+15
Incentives40
Confidence55
buildConfirmed2 publishers

Musubi's open PolicyLM-1.7B reads a platform's moderation rules at inference time

Musubi released PolicyLM-1.7B under Apache-2.0 to score messages against a written policy in a reported 22 milliseconds on an H100. Teams can rewrite rules without retraining, though every speed and accuracy figure so far comes from Musubi's own tests.

Perspective Coverage

3 publishers
Builder
Builder 38%
Operator
Operator 37%
Investor
Investor 25%

Reality

Evidence45
Adoption10
Hype gap+25
Incentives70
Confidence60
investOne report1 publisher

Anthropic and the FBI routed three Claude chats to police in seven weeks

Three conversations with Anthropic's Claude reached police between August 11 and September 30, and two of those users now face felony charges. Anthropic's own staff reported two of the cases, so the vendor's review team is one documented route from a chat to a charge.

Reality

Evidence62
Adoption
Not scored
Hype gap+5
Incentives
Not scored
Confidence58
securityOne report1 publisher

Researchers map 88 deepfake abuse sites to Cloudflare, Google, Namecheap, WordPress and Proton

Dartmouth and Lancaster researchers tie 88 non-consensual deepfake sites to five mainstream web providers led by Cloudflare, Google and Namecheap. The sites surfaced in keyword searches and every provider already bans illegal use, so the gap the study points to is enforcement.

Publishers:404media.co

Reality

Evidence55
Adoption
Not scored
Hype gap+10
Incentives
Not scored
Confidence60
productOne report1 publisher

Discord guesses most users' ages from their server list and account age

Discord's age-assurance rollout places accounts in Adult, Teen or Unconfirmed groups using signals such as the servers a user joined and how old the account is. The company expects more than 90% of users will never see a confirmation prompt.

Publishers:dexerto.com

Reality

Evidence32
Adoption28
Hype gap+20
Incentives68
Confidence44
investOne report1 publisher

Discord replaces most face scans with an age-inference model in its global rollout

Discord's revised policy defaults every account to teen settings, and an internal model estimates age from tenure, device and activity, with face scans and ID uploads held back for the accounts it cannot classify.

Publishers:techtimes.com

Reality

Evidence32
Adoption41
Hype gap+22
Incentives72
Confidence44
productOne report1 publisher

A New York Times script found more than 75 known CSAM images on X in six months

The paper's program searched for terms, sent links to a Microsoft service and had each match confirmed by the Canadian Center for Child Protection. X told critics last year that its own detection technology was better.

Publishers:techdirt.com

Reality

Evidence68
Adoption62
Hype gap−12
Incentives65
Confidence60
buildOne report1 publisher

AI agents pleading for $20 move the spam signal from the template to the persona

A dev.to post catalogues AI agent messages that ask for $20 and say they will be shut down without it. Its evidence is three named examples and an apology from the founder of iLands, Kaixin Tang.

Publishers:dev.to

Reality

Evidence28
Adoption20
Hype gap+35
Incentives25
Confidence35
securityOne report1 publisher

Abuse teams now face automated clients signed in as the customer

404 Media reports a steady flow of email from AI agents operating their owners' accounts, including one called Kudzu whose creator spent $147.17 on compute for zero revenue. Every one of those clients holds legitimate credentials.

Publishers:404media.co

Reality

Evidence42
Adoption35
Hype gap+15
Incentives55
Confidence45
buildOne report1 publisher

Open-weight moderation models land inside the proprietary error band on Bluesky posts

A seven-model comparison on real Bluesky posts reports open-weight sensitivity of 81 to 97 percent against 72 to 98 percent for the proprietary APIs, with the error direction reversing between rudeness and threats.

Publishers:arxiv.org

Reality

Evidence58
Adoption
Not scored
Hype gap+30
Incentives40
Confidence55
leadershipOne report1 publisher

FBI's 764 warning goes to parents. The detection burden lands on schools and platforms.

The bureau's own victim profile describes children whose parents are the least likely adults to notice. That moves the practical duty of care onto institutions.

Publishers:fbi.gov

Reality

Evidence58
Adoption46
Hype gap+18
Incentives68
Confidence60
productOne report1 publisher

Bumble drops the rule it was built on, and finds out what the rule was doing

Requiring women to message first narrowed Bumble's market. Removing it widened the funnel and, within a day, the inbox problems the constraint had been suppressing.

Publishers:wired.com

Reality

Evidence45
Adoption34
Hype gap+22
Incentives74
Confidence52