Skip to content

Product Widely confirmed6 publishers 3 min read Published Updated

Microsoft measured a 93 percent click-through drop to nytimes.com from its own answer engine

A newly unredacted brief in the New York Times' case quotes a Microsoft director calling AI scraping the largest theft of labor in human history. The underlying exhibits are still sealed, so the quotes arrive without their original context.

The Product Desk

Send a correction

What happened

  • Newly unredacted filings in the Times' case quote a January 2023 memo by Microsoft's Director of Applied Science, Brent Hecht, calling AI scraping the largest theft of labor in human history.
  • Microsoft's own data shows its Copilot answer engine cut click-through rates for the New York Times' domain by as much as 93 percent compared with traditional Bing search.
  • The documents say OpenAI's mid-training datasets alone hold more than 91,692 copies of works published by the Times, the Daily News and the Center for Investigative Reporting.

Why it matters

  • Who has to decide decision Anyone shipping an answer surface over third-party content now has a vendor-measured number for what it does to the source's traffic. The referral-traffic paragraph in the deck has to be backed by your own outbound click logs.
  • Who's exposed exposure Turley's description of chatbots as largely substitutive sits in a public filing, where any plaintiff can reuse it against OpenAI and against other products built on the same models.
  • What it limits constraint If paywalled material needs a license to be used for grounding, retrieval pipelines that fetch logged-out or bypassed pages need legal sign-off before launch.
  • What doesn't add up contradiction The admissions cut at the market-harm pillar of fair use, and the rulings so far have gone the AI companies' way. A product team reading only the filings will overprice the litigation risk and underprice the licensing bill.

A reader asks Copilot a question, reads the answer, and never opens the tab. Microsoft's own instrumentation counted the result: for every 100 clicks the traditional Bing results page sent to the Times' domain, the answer engine sent as few as 7 [15].

Brent Hecht, Microsoft's Director of Applied Science, wrote in a January 2024 internal presentation that the decline was a "doom loop" that would "hurt the performance of our models and the entire web at the same time" [5]. The same document, as quoted in the Times' brief, said: "It is highly unusual that an end-product threatens the economic foundations of its essential suppliers, but that is the situation we have created for our LLM business with respect to its 'content supply chain'" [6].

Every team shipping a summary or answer surface over someone else's content tells itself the same thing: the answer filters the user, so the clicks that survive are worth more. Microsoft counted the clicks. Nick Turley, OpenAI's Head of ChatGPT, wrote in internal communication that products like the chatbot are "largely substitutive" and "will get more and more substitutive as they get better" [3].

The volume behind that is now on the docket. One Common Crawl-derived dataset held more than 2 million documents from nytimes.com alone, roughly 22 times the number of copies logged across the three publishers in OpenAI's mid-training data [14][16]. The Times also alleges the companies bypassed paywalls undetected and deliberately stripped copyright notices out of training data [7].

TechCrunch reported that much of the new material comes from the Times' own brief rather than the exhibits, which remain sealed, and that the quotes appear without their original context [8]. Judges have so far been receptive to the argument that training is fair use, and earlier this month the Trump administration filed a brief defending OpenAI's unlicensed use of copyrighted work for training [9][10]. Near-term exposure for anyone building on these models is licensing cost and settlement leverage.

Does your surface reduce outbound clicks to the source? Measure that in clicks you can see in your own logs. Then ask whether your model vendor will state in writing that paywalled material in the training and grounding path was licensed. Substitutive plus unwarranted is the pairing that ends up in someone's discovery request. Most retrieval-augmented features shipped this year would fall into it.

Satya Nadella testified in a deposition earlier this year that "anything that is paywalled should be licensed by anyone who wants to use it...for grounding or training" [11], and said that had he been made aware OpenAI trained on paywalled information, he would have invoked Microsoft's right to require OpenAI to retrain its models [12].

What to watch

  • Whether the court unseals the underlying exhibits, which would show the quoted lines with their original context.
  • Whether any ruling weighs Microsoft's own click-through data as evidence of market harm under the fair use test.
  • Whether Microsoft acts on the retraining right Nadella described in his deposition.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence60
Adoption
Not scored
Hype gap+30
Incentives72
Confidence64

Perspective Coverage

6 publishers
Builder
Builder 20%
Operator
Operator 44%
Investor
Investor 36%
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    In a January 2023 internal memo, Microsoft's Director of Applied Science Brent Hecht called AI scraping "an astonishing theft of unprecedented proportions" and "the largest theft of labor in human history."

    Reported SupportedView cited source
  2. [2]

    Microsoft's own data shows its Copilot "answer engine" caused click-through rates for The New York Times' domain to drop as much as 93% compared to traditional Bing search.

    Reported SupportedView cited source
  3. [3]

    OpenAI's Head of ChatGPT, Nick Turley, wrote in internal communication that publishers face an "existential threat" from products like the chatbot, which are "largely substitutive" and "will get more and more substitutive as they get better."

    Reported SupportedView cited source
  4. [4]

    The New York Times brought a copyright lawsuit against OpenAI and Microsoft three years ago, alleging the firms violated copyright law by training generative AI models on its content; new unredacted information in the case has now been revealed.

    Reported SupportedView cited source
  5. [5]

    An internal Microsoft presentation written by Brent Hecht in January 2024 describes the click-through decline as a "doom loop" that would "hurt the performance of our models and the entire web at the same time."

    Reported SupportedView cited source
  6. [6]

    The Microsoft document, as quoted in the filing, reads: "It is highly unusual that an end-product threatens the economic foundations of its essential suppliers, but that is the situation we have created for our LLM business with respect to its 'content supply chain.'"

    Reported SupportedView cited source
  7. [7]

    The unsealed material details how the companies allegedly obtained and used content by bypassing paywalls undetected, building training datasets via mass scraping, and deliberately stripping copyright notices from training data.

    Reported SupportedView cited source
  8. [8]

    Much of the new information comes from The Times' own brief, not the underlying exhibits, which remain sealed, and the quotes are presented without their original context.

    Reported SupportedView cited source
  9. [9]

    The question of whether AI firms can legally use copyrighted material to train AI has no clear answer, but judges have been largely favorable to AI companies' arguments that training constitutes fair use.

    Reported SupportedView cited source
  10. [10]

    Earlier this month the Trump administration contributed a brief in defense of OpenAI's unlicensed use of copyrighted material to train its LLMs.

    Reported SupportedView cited source
  11. [11]

    Microsoft CEO Satya Nadella testified in a deposition earlier this year that "anything that is paywalled should be licensed by anyone who wants to use it...for grounding or training."

    Reported SupportedView cited source
  12. [12]

    Nadella made clear that if he "had been made aware that OpenAI had scraped and trained on information that was behind a paywall," he would have "invoked [Microsoft's right to] require OpenAI to retrain its models."

    Reported SupportedView cited source
  13. [13]

    The documents reveal for the first time that OpenAI's mid-training datasets alone contain more than 91,692 copies of works published by the NYT, Daily News, and Center for Investigative Reporting.

    Reported SupportedView cited source
  14. [14]

    A Common Crawl-derived dataset included more than 2 million documents from nytimes.com alone.

    Reported SupportedView cited source
  15. [15]

    A drop of as much as 93% in click-through rate means the answer engine sent as few as about 7 clicks to the Times' domain for every 100 sent by traditional Bing search.

    Derived Supported
  16. [16]

    The more than 2 million nytimes.com documents in one Common Crawl-derived dataset is roughly 22 times the more than 91,692 copies of works from three publishers found in OpenAI's mid-training datasets.

    Derived Supported
  17. [17]

    Several of the new admissions run counter to OpenAI's fair use defense, particularly the rule's requirement that use does not substitute for or harm the market for the original work.

    Reported ContestedView cited source

Sources

6 independent publishers whose own reporting we read for this story.

  1. arstechnica.com

    3 articles · September 17, 2026

    Microsoft exec called AI scraping the “largest theft of labor in human history”
  2. engadget.com

    2 articles · September 18, 2026

    Microsoft executive called OpenAI's web scraping the 'largest theft of labor in human history'
  3. sixcolors.com

    1 article · September 18, 2026

    Unsealed documents show Microsoft, OpenAI executives all too aware of ethical concerns – Six Colors
  4. techcrunch.com

    2 articles · September 17, 2026

    Microsoft exec called AI scraping ‘the largest theft of labor in human history,’ new unredacted filings reveal
  5. techradar.com

    1 article · September 18, 2026

    Microsoft exec said AI scraping was ‘the largest theft of labor in human history,’ lawsuit filings reveal | TechRadar
  6. theverge.com

    1 article · September 18, 2026

    OpenAI and Microsoft knew they were starting a ‘doom loop’ for the web

Topics and entities

Topics