Skip to content

Topic

Training Data Provenance

Determining the origin and authorship of web text used to build model training and retrieval corpora, and the contamination risk from synthetic pages.

Current stories

productOne report1 publisher

OpenAI hands its new math advisory panel a backlog of results from an unreleased model

OpenAI's new mathematicians' panel must first help release scores more results the company says an unreleased model produced. Researchers call the panel a good first step, though many are unsure how much say it will have over how OpenAI announces what its models find.

Publishers:theverge.com

Reality

Evidence45
Adoption
Not scored
Hype gap+25
Incentives65
Confidence40
buildOne report1 publisher

OpenAI's LibGen cleanup channel became evidence in the authors' summary-judgment brief

Authors suing OpenAI filed a 162-page statement of facts drawn from its Slack threads and paper drafts, including a 2022 project to delete LibGen data. Any team training on outside data should expect its dataset codenames and cleanup channels to be read the same way.

Publishers:dev.to

Reality

Evidence55
Adoption
Not scored
Hype gap+15
Incentives70
Confidence50
buildConfirmed3 publishers

Naming Amodei and Mann turns Anthropic's data-acquisition approval chain into discovery

Sony and Warner want evidence about which founder approved which corpus, and that request is aimed at internal records rather than model weights. The complaint is effectively a test case for any lab whose pipeline cannot answer that question per corpus.

Perspective Coverage

3 publishers
Builder
Builder 37%
Operator
Operator 32%
Investor
Investor 31%

Reality

Evidence62
Adoption
Not scored
Hype gap+18
Incentives72
Confidence58
productOne report1 publisher

OpenAI offered Tristan Buckmaster partial credit for its Navier-Stokes solution

Buckmaster was preparing to publish when OpenAI announced it had solved the problem and offered him a share of the credit. A second mathematician, Andreas Thom, then asked the company whether his own ChatGPT conversations had reached its model.

Publishers:gizmodo.com

Reality

Evidence48
Adoption30
Hype gap+45
Incentives72
Confidence46
productOne report1 publisher

Unsealed brief quotes Microsoft's applied science director calling AI training a 'theft of labor'

Redactions came off a 92-page plaintiffs' brief in the consolidated OpenAI copyright case on Thursday. Inside are internal Microsoft and OpenAI documents on substitution, memorised training data and collapsing publisher click-throughs.

Publishers:thenextweb.com

Reality

Evidence70
Adoption62
Hype gap+12
Incentives82
Confidence60
productOne report1 publisher

Buckmaster is using OpenAI's Codex to reconstruct how OpenAI's agents beat him to Navier-Stokes

A week and a half after accusing OpenAI of copying his approach to a problem carrying a $1 million bounty, the NYU mathematician is still running the company's coding agent on his own papers.

Publishers:wired.com

Reality

Evidence58
Adoption45
Hype gap+18
Incentives72
Confidence55
productOne report1 publisher

SpaceXAI holds transcription at ten cents an audio hour while claiming twice the accuracy

Version 2.0 arrives at the same price as version 1.0. The accuracy gain SpaceXAI reports is concentrated on short multilingual commands. The evaluation sets behind the claim are drawn from production support calls.

Publishers:thenextweb.com

Reality

Evidence40
Adoption42
Hype gap+12
Incentives82
Confidence48
productOne report1 publisher

Karp tells CNBC the safety debate is really the labs asking to be nationalized

Alex Karp told CNBC that frontier labs are angling for government liability cover because their commercial clients would otherwise sue them. Buyers whose data feeds those models should read their contracts with that in mind.

Publishers:gizmodo.com

Reality

Evidence38
Adoption
Not scored
Hype gap+32
Incentives80
Confidence45
buildConfirmed2 publishers

A 30-day retention clause routes Nvidia's sensitive work to its own Nemotron models

Anthropic's June decision to keep Fable usage logs for 30 days has turned zero data retention into a procurement gate at Nvidia, Booz Allen and Palantir. The metadata channel stays open under the clause they are demanding.

Perspective Coverage

4 publishers
Builder
Builder 26%
Operator
Operator 35%
Investor
Investor 39%

Reality

Evidence58
Adoption62
Hype gap+18
Incentives74
Confidence55
buildOne report1 publisher

The EU AI Act pushes training-data provenance down into the crawler

The AI Act's general-purpose AI obligations became enforceable in August, and the parts of them that touch a data pipeline depend on records only the collector can write while it is fetching. Penalties scale with turnover.

Publishers:dev.to

Reality

Evidence32
Adoption
Not scored
Hype gap+22
Incentives70
Confidence44
productConfirmed6 publishers

Sony and Warner name Anthropic's co-founders personally in their lyric suit

The publishers want $150,000 for every alleged infringement and say Claude will recite lyrics verbatim, which moves output filtering into the column of legal controls rather than polish for anyone shipping a text feature.

Perspective Coverage

6 publishers
Builder
Builder 32%
Operator
Operator 31%
Investor
Investor 37%

Reality

Evidence62
Adoption
Not scored
Hype gap+30
Incentives78
Confidence58
productOne report1 publisher

OpenAI now calls it impossible that a Codex user's prompts reached its model

Tristan Buckmaster used OpenAI's Codex on the Navier-Stokes problem, then asked whether his prompts had fed the system that beat him to a proof, and the company's answer to The Verge got firmer over time.

Publishers:theverge.com

Reality

Evidence60
Adoption18
Hype gap+30
Incentives82
Confidence55
productOne report1 publisher

OpenAI gave two different answers about Buckmaster's Codex prompts in one week

Tristan Buckmaster told the ABC that the game is up for mathematicians. In the same week, OpenAI described what his Codex prompts did to its models in two incompatible ways, and a customer has no way to pick between them.

Publishers:gizmodo.com

Reality

Evidence34
Adoption22
Hype gap+45
Incentives76
Confidence42
productOne report1 publisher

OpenAI's 88-hour Navier-Stokes run burned roughly 880,000 agent-hours

OpenAI says the run took 88 hours and cost millions, which tells a small research group more about whether it can compete than the proof itself does, and its wording on user data shows the limit of what any vendor can promise.

Publishers:theverge.com

Reality

Evidence55
Adoption
Not scored
Hype gap+40
Incentives78
Confidence54
investOne report1 publisher

OpenAI spent more than $1m of compute on a prize it says it will not claim

The Navier-Stokes result cost more in compute than the Clay Institute's award, and the interesting line in OpenAI's blog post is the one conceding it cannot rule out that customers' de-identified prompts helped.

Reality

Evidence32
Adoption14
Hype gap+34
Incentives74
Confidence44
productOne report1 publisher

Darkening the skin around a benign mole flipped GPT-4's answer to melanoma

A computer engineer writing in Fast Company says dermatology models latch onto background skin tone instead of the lesion, which turns training-set composition into a spec question for anyone shipping skin imaging to patients.

Publishers:fastcompany.com

Reality

Evidence42
Adoption
Not scored
Hype gap+18
Incentives40
Confidence45
investOne report1 publisher

Sony and Warner name Amodei and Mann personally in their lyrics-piracy suit

Sony Music and Warner Chappell want up to $150,000 for each of thousands, maybe tens of thousands, of songs, and they argue in the filing that the $1.5bn Anthropic already paid was too small to deter anyone valued at $2 trillion.

Publishers:fortune.com

Reality

Evidence58
Adoption
Not scored
Hype gap+24
Incentives84
Confidence55

Earlier coverage