Publishers Lobbying Congress on AI Crawlers

Home › Guides › Publishers Lobbying on AI Crawlers

✓ checked 20 October 2026 · source: LDA.gov lobbying disclosures, retrieved 20 October 2026 · the filings · method · download the data

News publishers have started lobbying Congress about AI crawlers. Federal lobbying reports filed so far in 2026 include 7 that name crawlers, stealth bots or the Stealth Bot Prohibition Act, H.R. 9915. All come from 4 publishing clients: News Corp, People Inc., Advance Publications and the News Media Alliance. The 6 reports filed by outside lobbying firms list $250,000 in fees between them. We found no such reports in 2024 or 2025.

7 reports in 20264 publishing clients$250,000 in outside-firm fees4 filed for July–September

What the bill is

H.R. 9915, the Stealth Bot Prohibition Act, was introduced by Rep. Laurel Lee (R-FL) on 23 July 2026 and referred to the House Energy and Commerce Committee. Congress.gov has not yet published a summary. People Inc.’s lobbying firm described its work as support for the bill’s “transparency requirements for automated web crawlers and AI data-scraping bots, including a prohibition on bots that conceal their identity or impersonate human users.” Publishers’ main tool against AI crawlers today is robots.txt, which only works when a crawler announces its name; a crawler that disguises itself as an ordinary browser can’t be singled out that way. That is the gap the bill’s supporters describe. For how sites use robots.txt against AI bots, see our AI-crawler census and which AI companies block their rivals’ crawlers.

How lobbying disclosure works

Under the Lobbying Disclosure Act, organisations that lobby Congress or federal agencies file a quarterly report, called an LD-2. A lobbying firm reports the fee its client paid for the quarter; an organisation that lobbies with its own staff reports what it spent. Each report lists issue areas and, in free text, the specific issues and bills lobbied on. The fee covers everything in the report, so the amounts below are not money spent on crawlers alone. Reports for July–September were due on 20 October 2026, the day we retrieved the data, so late filings may still appear.

The 7 reports

PostedReportClientFiled byAmount (whole report)What the report says about crawlers
20 AprQ1 (Jan–Mar)Advance PublicationsNVG$50,000 feeGeneral issues related to technology platforms and users, including children. Issues related to subscription renewals. Executive Order Ensuring a National Policy Framework for Artificial Intelligence. S.2367 – AI Accountability and Personal Data Protection Act. Issues related to crawlers.
20 JulQ2 (Apr–Jun)Advance PublicationsNVG$50,000 feeGeneral issues related to technology platforms and users, including children. Executive Order Ensuring a National Policy Framework for Artificial Intelligence. S.2367 – AI Accountability and Personal Data Protection Act. H.R.8479 – Protecting Consumers from Deceptive AI Act. Issues related to crawlers. H.R.7757 – KIDS Act.
20 JulQ2 (Apr–Jun)News Media AllianceFierce Government Relations$40,000 feeImpact of artificial intelligence on content providers; S.1748/H.R.6484 – Kids Online Safety Act; Issues related to stealth crawlers.
13 OctQ3 (Jul–Sep)News CorpBL Partners Group$30,000 feeIssues related to copyright – no specific legislation. Issues related to AI including H.R. 9915 – Stealth Bot Prohibition Act. / Issues related to privacy and security – no specific legislation. Issues related to AI including H.R. 9915 – Stealth Bot Prohibition Act.
15 OctQ3 (Jul–Sep)News CorpNews Corp (its own lobbyists)$200,000 spentIssues related to intellectual property protection and generative artificial intelligence; H.R. 9915 Stealth Bot Prohibition Act (119th).
16 OctQ3 (Jul–Sep)People Inc.Squire Patton Boggs$30,000 feeAdvocated in support of H.R. 9915, Stealth Bot Prohibition Act – issues related to transparency requirements for automated web crawlers and AI data-scraping bots, including a prohibition on bots that conceal their identity or impersonate human users.
20 OctQ3 (Jul–Sep)Advance PublicationsNVG$50,000 feeGeneral issues related to technology platforms and users, including children. Executive Order Ensuring a National Policy Framework for Artificial Intelligence. S.2367 – AI Accountability and Personal Data Protection Act. H.R.8479 – Protecting Consumers from Deceptive AI Act. Issues related to crawlers. H.R.9915 – Stealth Bot Prohibition Act. H.R.7757 – KIDS Act.

All filings are 2026 quarterly reports. Amounts are as reported and cover every issue in the report. Links to each filing are in the CSV.

  • Advance Publications, through the firm NVG, has listed “issues related to crawlers” in all three of its 2026 reports so far, at $50,000 a quarter ($150,000 in total). Its July–September report, posted on 20 October, adds H.R. 9915.
  • News Corp appears twice for July–September: through the firm BL Partners Group ($30,000), which names H.R. 9915 under both copyright and privacy issues, and in its own report, which names the bill alongside “intellectual property protection and generative artificial intelligence”. News Corp’s own report lists $200,000 in lobbying spending for the quarter across all issues, which we don’t add to the fee total.
  • People Inc., the publisher formerly known as Dotdash Meredith, paid Squire Patton Boggs $30,000 for a quarter in which it “advocated in support of H.R. 9915”, lobbying the Senate.
  • The News Media Alliance, a trade association for news publishers, listed “issues related to stealth crawlers” in its April–June report from Fierce Government Relations ($40,000).

4 of the 7 reports name H.R. 9915; the earlier ones, filed before the bill was introduced, refer to crawlers in general. Several other 2026 reports mention the SAFE BOTs Act (H.R. 6489), a bill about AI chatbots and children, which isn’t about crawlers and isn’t counted here. Lobbying about automated ticket buying is covered on our BOTS Act page.

What this doesn’t show

  • Fees and spending cover every issue in a report, so they can’t be split by issue.
  • Reports describe issues in the filer’s own words. A report that lobbied on crawlers without using words such as crawler, scraping or stealth bot wouldn’t be found.
  • Reports don’t say which side of an issue a client took unless the filer writes it, as People Inc.’s firm did.
  • State lobbying isn’t included.

Method

We searched the LDA.gov API on 20 October 2026, the filing deadline for July–September reports, for 2026 filings whose specific-issue text matches crawler, crawlers, crawling, scraping, scraper, scrapers, web scraping, data scraping, web crawlers, stealth, stealth bot, AI bots, bot traffic or 9915. We kept a report if the text of at least one issue mentions crawling, scraping, stealth bots or H.R. 9915, and read each one by hand. A search of 2024 and 2025 filings for crawler, crawlers, crawling, scraping, scrapers, web scraping, stealth, stealth bot and 9915 found none. Amounts are the income or expenses field of each report. A separate script re-reads the raw API responses and rechecks every number.

Senate Office of Public Records cannot vouch for the data or analyses derived from these data after the data have been retrieved from LDA.gov.

Download the data

  • Publisher lobbying on AI crawlers, 2026 (CSV): one row per report, with client, filer, quarter, amount, issue areas, the relevant issue text, the number of lobbyists named on those issues, the chambers lobbied and a link to the filing.

Cite as: ProxyPicker, “Publishers Lobbying Congress on AI Crawlers”, 20 October 2026, https://proxypicker.com/publisher-lobbying-ai-crawlers/.

Related: Web scraping law hub · AI companies and rival crawlers · BOTS Act cases.

Press & data requests: email [email protected] for interviews, the raw data behind this page, or corrections. See also our contact page.