Home › Changelog
Every pricing change, promo update and market event we verify, newest first. This is the record the rest of the site is built on.
| Date | Provider | Type | What changed |
|---|---|---|---|
| 2026-11-02 | all | price | Monthly price sync: 25 pages re-checked against providers’ pricing pages on 2026-11-02. Changes: Oxylabs moved to a single subscription (Starter $30, Basic $100, Flexible $500, Enterprise from $2,500/month) with published ladders for mobile ($7.50 to $3.50/GB), ISP ($1.50 to $1.10/IP) and datacenter ($0.60 to $0.40/GB); its ISP “from $16” and SOCKS5 “from $8” figures are gone; ProxyEmpire rotating mobile now from $2.00/GB (was $1.25); NodeMaven ISP now from $2.33/IP per 30 days (was $2.99); Proxy-Seller residential volume plans now from $1.45/GB (was $1.30). Other tracked rates unchanged. |
| 2026-11-02 | — | site | Proxy cost calculator and embeddable widget: all rates re-read on 2026-11-02 (unchanged); Proxy-Seller note updated to say enterprise rates from $0.3/GB are quoted through sales (the “From $1.30/GB” line is no longer on its page). |
| 2026-10-28 | 3D Model Sites and AI Crawlers: Who Blocks Them in robots.txt | New | robots.txt of 29 3D model sites: 6 of 24 readable block a known AI crawler sitewide; none name trellis2 (Open3DLab incident). CSV. |
| 2026-10-28 | Health Insurers Must Let Web Crawlers Reach Price Files | New | Transparency in Coverage final rule (91 FR 63748): price files must be open to any web crawler, no CAPTCHA/403; applies 2027. Spot check of 12 insurer pages, CSV. |
| 2026-10-28 | VPN App CVEs: 57 Records, Private Internet Access Leads | New | VPN app CVEs (NVD, read by hand): 57 records for 12 of 13 brands; PIA 13, Windscribe 7, PureVPN 7, NordVPN 6; 38 privilege escalation. CSV. |
| 2026-10-28 | WebMCP: Where Chrome’s Web API for AI Agents Stands | New | WebMCP status: origin trial Chrome 149–156, extension to 162 requested 28 Sep; WebKit oppose, Mozilla neutral, TAG review open. Timeline CSV. |
| 2026-10-28 | Tor Relays After the 0.4.9.14 Security Release | New | Tor relay upgrades (Onionoo 28 Oct 16:00 UTC): 6,997 of 9,208 running relays (76.0%) on 0.4.9.14/0.4.9.15; exits 88.4%, guards 74.6%; 1,140 obsolete. CSV. |
| 2026-10-27 | agent-browser vs Playwright: npm Downloads | Updated | Added 27 October update: chrome-devtools-mcp 7,338,150 npm downloads in 30 days to 26 Oct (14.8x a year earlier), @playwright/mcp 24,762,687 (10.1x); PyPI undetected-chromedriver 2,039,101 in Sep, camoufox, zendriver, nodriver monthly. One CSV. |
| 2026-10-27 | Which News Sites Block Meta’s Crawlers | Updated | Added 27 October update: CC-MAIN-2026-43 sample of 9,244 robots.txt files — Meta-ExternalAgent named in 4.29% (83 whole-site disallows), GPTBot 5.72%, Meta-ExternalFetcher 27 files, Meta-WebIndexer 16, meta-externalads 8. One CSV. |
| 2026-10-27 | Wikipedia’s Bot Traffic: Automated vs Human Pageviews | Updated | Added 27 October update: non-user share of pageviews in Sep 2026 — Wikidata 89.2% (94.3% Oct 2025), Commons 80.0%, English Wikipedia 34.2% (29.4%). One CSV. |
| 2026-10-27 | Web Bot Auth: Standards Tracker | Updated | Added 27 October update: web-bot-auth npm downloads 885 (Oct 2025) to 613,748 (Sep 2026), 652,969 in 30 days to 26 Oct; http-message-signatures 236,171. One CSV. |
| 2026-10-27 | What AI Agents Pay to Read 1,000 Web Pages | New | AI fetch API list prices per 1,000 pages (official pricing pages): DeepSeek Fetch $0.75, Exa Contents $1.00, Tavily Extract $1.60 PAYG, Firecrawl $0.60-$3.80 by plan. CSV. |
| 2026-10-27 | Anti-Detect Browser CVEs: Kameleo’s First Five | New | Anti-detect browser CVEs (NVD): Kameleo 5 published 26 Oct (1 SSRF in proxy test, 4 info disclosure; 3 fixed in 5.2.0, 2 no fix stated); 7 rivals 0. CSV. |
| 2026-10-27 | Airlines, Banks and Travel Sites: What Their robots.txt Says to AI Agents | New | robots.txt of 55 airline, travel, bank and marketplace sites vs 15 AI agent names: airlines 0/13, banks 2/15, travel 8/14; ChatGPT-User named in 12, fully blocked in 0. CSV. |
| 2026-10-27 | Scraping Tool CVEs: Crawl4AI vs Firecrawl, changedetection.io and Scrapy | New | Scraping tool CVEs (NVD): Crawl4AI 27 in 2026 (9 SSRF), changedetection.io 22, Firecrawl 3, Scrapy 2; 5 keyword false matches removed. CSV. |
| 2026-10-27 | When the Firewall Is the Way In: Security Products on CISA’s Exploited List | New | CISA KEV: SiteGuard WAF CVE-2026-106931 added 20 Oct; 49 of 276 2026 additions are security products (17.8%) vs 34/245 in 2025 (13.9%), hand-classified. CSV. |
| 2026-10-27 | Tor Use in Azerbaijan After the Social Media Restrictions | New | Tor Metrics users from Azerbaijan after the 12 Oct 2026 social-media restrictions: peak 2,415 on 13 Oct (+70% vs 1,419 baseline), 5 days above expected range, bridges flat. CSV. |
| 2026-10-27 | curl’s Proxy Security Flaws: 2026 vs the Previous 23 Years | New | curl proxy-handling security advisories: 7 published in 2026 vs 8 in 2003-2025, all 7 about proxy credentials/auth; 10.1% of 2026 curl advisories. Hand-checked list, CSV. |
| 2026-10-27 | Do Europe’s Privacy Regulators Block AI Crawlers? | New | robots.txt of 33 European data-protection regulators ahead of the EDPB scraping consultation closing 30 Oct: 1 of 24 readable files names an AI crawler (Dutch AP, GPTBot). Plus HTTP Archive Sept 2026 GPTBot rules (EU 4.6%, .com 10.3%) and robots.txt parser downloads. CSV. |
| 2026-10-24 | agent-browser vs Playwright: npm Downloads | New | Monthly npm downloads, Oct 2025 to Oct 2026, for Vercel’s agent-browser, Playwright, @playwright/mcp, Puppeteer and Browserbase: agent-browser 6.67M in Sep (1.7% of Playwright’s 400.9M). CSV. |
| 2026-10-24 | Bot ID Bills Compared: UK, US Congress and New York | New | UK Automated Online Software Bill (2nd reading 27 Nov; not reached 16 Oct) vs US H.R. 9915 (FTC, up to $53,000 per violation) vs NY S9934-A (passed both chambers; AG, $15,000/day). 12-provision comparison. CSV. |
| 2026-10-24 | Which News Sites Block Meta’s Crawlers | New | Live robots.txt of 65 news sites ahead of Meta’s 30 Oct Commercial Terms: Meta-ExternalAgent disallowed on 38 (GPTBot 34, ClaudeBot 49); facebookexternalhit on 0. 14 crawler tokens per site. CSV. |
| 2026-10-23 | MASQUE Tracker | Updated | Added 23 October update: new MASQUE charter (rev 04) approved 22 Oct to finish 4 drafts and close; CONNECT-TCP moved to Revised I-D Needed after the 22 Oct telechat (1 Yes, 10 No Objection, 1 Discuss); Ethernet draft approved 16 Oct; 127 revisions, 27 in 2026. One CSV. |
| 2026-10-23 | Proxy Bugs in HTTP Libraries | Updated | Added X-Forwarded-For CVEs: 73 in NVD in 2026 to 23 Oct (55 in 2023–2025 combined; 0.044% to 0.083% of all CVEs), all 73 hand-checked, 55 about trusting a spoofed client address; 20 since 22 Sep. Two CSVs. |
| 2026-10-23 | What the Newspapers Suing OpenAI Block in robots.txt | New | Live robots.txt of the 19 USA TODAY Co. publications in USA TODAY Co. v. OpenAI: 276 agents fully disallowed on every site (90 scraping/proxy tokens from 39 brands); 6 AI agents keep Allow exceptions for sponsored and branded sections. Two CSVs. |
| 2026-10-23 | Which CISA KEV Bugs Have Free Metasploit or Nuclei Tooling | New | CISA KEV catalogue 2026.10.21 joined to Metasploit module references and Nuclei CVE templates: 759 of 1,754 entries (43.3%) covered; Metasploit 529, Nuclei 507, both 277. Two CSVs. |
| 2026-10-23 | Which CAPTCHA Do Federal Websites Use? | New | GSA Site Scanning data (21 Oct 2026): 763 of 11,895 live federal URLs load a CAPTCHA; reCAPTCHA 440, hCaptcha 246, Cloudflare 60, BotDetect 12, AWS WAF 4, HUMAN 1. Two CSVs. |
| 2026-10-23 | Iran’s 2026 Blackout in Open Data | New | Chrome UX Report origins for Iran fell from 319,590 (Feb 2026) to 30,794 (Mar), and Persian Wikipedia views from the US fell 69%, consistent with VPN exits. One CSV. |
| 2026-10-23 | eMudhra Certificate Compromise: Who Has Patched | New | Trust-store and TLS-library fixes after the eMudhra intermediate key compromise (Cisco Talos, 21 Oct): Mozilla, Go, Node.js, Red Hat, mitmproxy, and four certifi releases (121, 117, 120, 118 roots). Two CSVs. |
| 2026-10-23 | DHS Orders DeepSeek Out of Federal IT | New | The DHS FASCSA order removing DeepSeek from federal civilian IT (Federal Register 2026-21447), and federal .gov robots.txt files: 2 of 452 name DeepSeekBot, 35 name a Chinese-operated AI bot. Two CSVs. |
| 2026-10-21 | Proxy & Gateway CVE Ledger | Update | New section: 31 NVD CVEs for pfSense and OPNsense published on 15 October 2026 (21 pfSense, 10 OPNsense), 5 of them in OpenVPN or IPsec code; none in CISA KEV. One CSV. |
| 2026-10-21 | MASQUE Tracker | Update | New section: MASQUE apps on F-Droid (3 of 70 VPN & Proxy apps, all added since late August 2026) and the category’s growth. One CSV. |
| 2026-10-21 | MCP Servers and SSRF | Update | New section: SSRF flaws in CISA’s Known Exploited Vulnerabilities catalog (11 added in 2026, more than 2022–2025 combined; newest two in Plex Media Server). One CSV. |
| 2026-10-21 | VPN Apps in the App Store Top Charts | Update | New section: VPN websites in Chrome’s top 5,000 by country (CrUX, Sep 2025 vs Sep 2026): Proton VPN 43 → 66 countries; Happ highest in Russia. One CSV. |
| 2026-10-21 | isbot npm Downloads | New | npm downloads of the isbot user-agent bot check (109,958,112 in September 2026, 12.2× a year earlier), the React Router dependency, and two other bot-detection packages. One CSV. |
| 2026-10-21 | Iran’s Snowflake Requests, a Year On | New | Tor Snowflake broker statistics: requests from Iran (3.9× a year earlier) and Russia, volunteer proxies by country, monthly since December 2024. One CSV. |
| 2026-10-21 | The IETF’s AI-Agent Draft Surge | New | New IETF Internet-Drafts about AI agents (216 in 2026, 65 in 2025, 1 in 2024) by month and topic, and the new agentproto working group. One CSV. |
| 2026-10-20 | Every Federal BOTS Act Case | Update | New section: 45 state and federal ticket-bot bills with action in 2025–2026 (21 states, D.C. and Congress), 9 enacted. One CSV. |
| 2026-10-20 | Proxy & Gateway CVE Ledger | Update | New section: 134 NVD CVEs for Windows Routing and Remote Access Service (RRAS) since 2024, including 13 on 13 October 2026 (two rated 9.8); none in CISA KEV. One CSV. |
| 2026-10-20 | What Your Wi-Fi Is Worth | Update | New section: how the Emerging Threats Open IDS ruleset labels bandwidth-sharing apps (12 domains added as Bandwidth Sharing Tool on 11 February 2026; Honeygain and Pawns.app as INFO). One CSV. |
| 2026-10-20 | IPv4 Address Transfers | Update | New section: AFRINIC IPv4 space announced by networks registered outside Africa (NRO statistics and iptoasn, 20 October 2026), with AFRINIC’s 25 September recovered-space policy. Two CSVs. |
| 2026-10-20 | x402 Adoption: npm Downloads | New | npm downloads of x402, the open standard for HTTP 402 pay-per-request payments: monthly since February 2025, the top x402 packages, and the PyPI total. Two CSVs. |
| 2026-10-20 | Publishers Lobbying Congress on AI Crawlers | New | The 2026 federal lobbying reports (LDA.gov) that name crawlers, stealth bots or H.R. 9915, the Stealth Bot Prohibition Act, with fees and issue text, including July–September reports posted by 20 October. One CSV. |
| 2026-10-20 | Which AI Companies Block Rivals’ Crawlers | New | robots.txt files from 50 AI-company websites, fetched 20 October 2026: which AI crawlers and agents each names and blocks, and whose. Two CSVs. |
| 2026-10-19 | Scraping Law Hub | Updated: short section on DMCA anti-circumvention (§1201) takedown notices on GitHub in 2026, including how often GitHub notes it couldn’t find a valid claim and the WeChat and Kasada notices, linking to the new anti-bot bypass page. | |
| 2026-10-19 | Proxy Bugs in HTTP Libraries | Updated: new section on the five AsyncHttpClient (Java) CVEs published on 7 October, Mechanize (Ruby) CVE-2026-107715 and Go net/http CVE-2026-94439, with plain-English explanations, fixed versions and release dates. New CSV. | |
| 2026-10-19 | The AI Opt-Out Standard vs Real robots.txt Files | Updated: new section on WordPress.org plugins that create llms.txt files versus plugins that block or control AI crawlers (hand-checked, 1,399 plugins from 16 searches), with installs, year added and the large SEO plugins that include either feature. New CSV. | |
| 2026-10-19 | Malicious npm and PyPI Packages That Use Proxies | New: the 34 malicious npm and PyPI packages reported to OpenSSF malicious-packages in 2026 that turn the computer into a proxy, hide a proxy inside a backdoor, or route the user’s own traffic through someone else’s proxy, hand-classified from the report text, with background on proxyware. One CSV. | |
| 2026-10-19 | The Anti-Bot Bypass Economy in Numbers | New: npm and PyPI packages whose own descriptions claim to solve CAPTCHAs or bypass anti-bot systems, by type, with September 2026 downloads (hand-checked, no links to the tools), plus GitHub DMCA anti-circumvention notice counts 2021–2026 and the Tencent/WeChat and Kasada notices. Three CSVs. | |
| 2026-10-19 | Which US Retailers Block AI Shopping Agents | New: how the robots.txt files of 33 large US retail, marketplace and delivery sites treat AI training crawlers, AI search crawlers and user-triggered agents such as ChatGPT-User, parsed under RFC 9309, with background on Amazon’s September block of Meta’s Muse. Two CSVs. | |
| 2026-10-19 | Every Federal BOTS Act Case | New: all 7 federal BOTS Act ticket-bot cases (2021–2026) with what each complaint alleges (proxy IPs, account farms, multi-session browsers, SIM banks), penalties and status, including the 28 September Ticketmaster ruling and the 15 October REPS complaint. One CSV. | |
| 2026-10-18 | Scraping Law Hub | Updated: new section on 52 US bills that mention VPNs or proxy servers (LegiScan, CC BY 4.0), sorted by what the wording does, plus the 24 September injunction against Utah’s actual-location rule and the DEFEND IP Act’s VPN exclusion. New CSV. | |
| 2026-10-18 | Starlink’s IP Geofeed, a Year On | New: IPv4 addresses and IPv6 prefixes per country in Starlink’s geofeed, 18 October 2026 vs 18 October 2025 (archived copy). CSV. | |
| 2026-10-18 | Which Networks Wikipedia Blocks From Editing | New: English Wikipedia’s 14,065 active IP range blocks by type and network (iptoasn), plus aggregate overlap with three public free-proxy lists (counts only). Three CSVs. | |
| 2026-10-18 | Which Federal .gov Sites Block AI Bots | New: robots.txt rules for 18 AI user agents across the 1,321 federal .gov domains in CISA’s list, fetched 18 October. Two CSVs. | |
| 2026-10-18 | VPN Apps in the App Store Top Charts | New: VPN and proxy apps in the top 100 free iPhone apps across 57 App Store storefronts (hand-checked listings), with GitHub download counts for AmneziaVPN and sing-box. Two CSVs. | |
| 2026-10-18 | Proxies in MITRE ATT&CK v20 | New page: threat groups, software and campaigns linked to Proxy and related techniques in ATT&CK v20 vs v19.2, plus residential-proxy mentions. Two CSVs. | |
| 2026-10-17 | Edge Devices in CISA’s Exploited-Vulnerabilities List | Updated: new section on BeyondTrust Remote Support (CVE-2026-102764, added 16 October, due 19 October) and BeyondTrust’s four catalog entries; catalog re-checked (still 2026.10.16). New dated CSV. | |
| 2026-10-17 | reCAPTCHA vs Turnstile: The CAPTCHA Shift | Updated: new section counting arXiv CAPTCHA papers that discuss LLMs, multimodal models or AI agents, 2022–2026 (hand-checked). New CSV. | |
| 2026-10-17 | The AI Opt-Out Standard vs Real robots.txt Files | Updated: new section on RSL licence lines and Content-Signal in robots.txt across Chrome’s top 1,000 origins (CrUX, September 2026), fetched 17 October. New CSV. | |
| 2026-10-17 | Where Privacy VPNs Host Their Servers | New page: Mullvad, IVPN and AirVPN servers from their public APIs, by hosting network (iptoasn.com). Two CSVs. | |
| 2026-10-17 | iCloud Private Relay’s Exit Network | New page: Apple’s Private Relay egress list by announcing network (iptoasn.com) and by country. Two CSVs. Linked from the proxy checker. | |
| 2026-10-17 | MCP Servers and SSRF | New page: GitHub-reviewed SSRF advisories by month, every MCP-related SSRF advisory, mcp-server-fetch’s new private-address guard and CVE-2026-104120, and MCP Registry servers about web proxies. Three CSVs. | |
| 2026-10-17 | Firefox Add-ons With Proxy Access | New page: Firefox extensions that require the proxy permission, with daily users, name-based counts and the top 50 classified by hand. One CSV. | |
| 2026-10-17 | AI Fetcher IP Ranges | New page: published IPv4 space for OpenAI ChatGPT-User, GPTBot and OAI-SearchBot, Google-Agent and Googlebot, and Perplexity, with Wayback Machine history. Two CSVs. | |
| 2026-10-16 | Source’s Brands in Chrome’s Traffic Ranks | New page: Chrome UX Report rank buckets for Oxylabs, Decodo, Webshare, Honeygain and ScrapingBee sites, with Bright Data for comparison. Two CSVs. | |
| 2026-10-16 | Proxy Bugs in HTTP Libraries | New page: 26 proxy-related advisories in eight Python and Node.js HTTP libraries, including urllib3 CVE-2026-97687 and proxy-addr CVE-2026-90711. Two CSVs. | |
| 2026-10-16 | Edge Devices in CISA’s Exploited-Vulnerabilities List | Updated to KEV release 2026-10-16 (1,748 entries; 293 edge devices). Added AhsayCBS (14 Oct), Zammad (2 Oct) and the five old CVEs added on 8 Oct. New CSV. | |
| 2026-10-16 | Anti-Bot Census: How Many Websites Screen for Bots? (2022–2026) | Updated: added a section on Anubis, the open-source proof-of-work wall, and its WebAssembly checks in v1.28.0 (8 Oct). Not counted in the census. New CSV of releases. | |
| 2026-10-16 | Wikipedia’s Bot Traffic: Automated vs Human Pageviews | Updated: added human (user) pageviews for the “Proxy server” and “Web scraping” articles as context; Web scraping had 56,067 in Sep 2026, its highest month since 2023. New CSV. | |
| 2026-10-15 | The Post-Quantum REALITY Split | New page: Xray REALITY servers require an X25519MLKEM768 key share since 8 Sep; sing-box still strips it. Dated timeline, code checks and two CSVs. | |
| 2026-10-15 | Tor Exit Relays After the October 2026 Incident | Updated: added Russian Tor bridge users (95,811 of 226,128 on 12 Oct) from Tor Metrics, with a daily CSV since January 2025. | |
| 2026-10-15 | Edge Devices in CISA’s Exploited-Vulnerabilities List | Updated to KEV release 2026-10-14 (1,745 entries; 293 edge devices). New section on BOD 26-04’s 3-day deadlines, PAN-OS CVE-2026-0322, Juniper’s 153 CVEs of 14 Oct and WatchGuard Fireware. New CSV. | |
| 2026-10-15 | Proxy & AI Gateway CVE Ledger | Updated: NVD re-fetched 15 Oct. Added frp (3 CVEs, incl. CVE-2026-110619 published 14 Oct), now 11 products and 600 CVEs; added a note on four OpenVPN CVEs from 13–14 Oct, kept outside the ledger. New CSV. | |
| 2026-10-15 | The Open-Source Scraping Index 2026: GitHub Stars, Downloads and the Rise of AI-Native Scrapers | Updated: added a section on six neighbouring tools, kept outside rankings and totals: browser MCP servers (Playwright MCP, Chrome DevTools MCP) and page-to-text extractors (Readability, Turndown, trafilatura, selectolax), with September 2026 vs September 2025 downloads. New CSV. | |
| 2026-10-14 | The Open-Source Scraping Index 2026 | Updated: GitHub re-pulled 14 Oct; added undici (classic HTTP) and patchright (stealth), now 26 scraping tools, plus workerd as an edge-runtime comparison row outside rankings and totals. AI-native share of new stars 61.9% (was 62.6%). New CSVs and charts. | |
| 2026-10-14 | Proxy & AI Gateway CVE Ledger | Updated: NVD re-fetched 14 Oct (keyword and CPE searches). Added Squid CVE-2026-61642 (HTTP/1.1 request smuggling, published 13 Oct), now 597 CVEs; added a note on Traefik CVE-2026-88010 (BasicAuth timing, already counted). New CSV. | |
| 2026-10-14 | Edge Devices in CISA’s Exploited-Vulnerabilities List | Updated to KEV release 2026-10-13 (1,741 entries, 292 edge devices). New section on recent Ivanti Connect Secure, MikroTik RouterOS, Fortinet FortiMail, F5 BIG-IP and Cisco additions, with NVD CVE counts by CPE. New CSV. | |
| 2026-10-13 | The Open-Source Scraping Index 2026 | Updated: GitHub re-pulled 13 Oct; added Skyvern (AI-native, 24 tools); new section with a Selenium vs Playwright table (stars, commits, npm, PyPI, Stack Overflow, HN), Scrapling vs Scrapy, and Crawlee’s scoped npm packages (@crawlee/core 1.0 million in Sep 2026). AI-native share of new stars 62.6% (was 61.7%). New CSVs. | |
| 2026-10-13 | Proxy & AI Gateway CVE Ledger | Updated: added Citrix NetScaler ADC/Gateway (109 CVEs, 18 in CISA KEV) and a table of Envoy’s 13 CVEs from the last 30 days; added NVD CPE searches, which raised LiteLLM from 35 to 47 CVEs and added CVE-2023-44487 to Envoy and Traefik. Now 596 CVEs across 10 products. New CSV. | |
| 2026-10-13 | Privacy Pass Tracker | New: all 27 IETF Privacy Pass drafts with status and revision history; 3 RFCs, 4 active drafts, batched tokens in AD evaluation, ARC work stopped July 2026. Two CSVs. Linked with the MASQUE and Web Bot Auth trackers. | |
| 2026-10-13 | IPv6 in Common Crawl, 2024–2026 | New: IPv6, HTTP/2 and TLS 1.3 shares for 22 Common Crawl crawls (CC-MAIN-2024-51 to 2026-39); IPv6 31.84% in Sep 2026 after a March 2026 crawler change. CSV. Linked both ways with Common Crawl Robots.txt Denials. | |
| 2026-10-12 | The Open-Source Scraping Index 2026 | Refreshed with 12 Oct 2026 data: GitHub stars and commits, PyPI (ClickHouse) and npm re-pulled; added jsdom, got-scraping and Camoufox (now 23 tools) and Chrome UX Report rank buckets for project websites (apify.com top 500k to top 100k). AI-native share of new stars 61.7% (was 63.5%). New CSVs. Linked from The Week Scraping Rebranded for AI. | |
| 2026-10-12 | Proxy & AI Gateway CVE Ledger: LiteLLM, HAProxy, Squid, Envoy | New page: 474 NVD CVEs for 9 self-hosted proxies and the LiteLLM AI gateway with CISA KEV status (LiteLLM 35 CVEs, 31 in 2026, 3 in KEV), one CSV. Linked from the KEV edge-devices page and MASQUE tracker. | |
| 2026-10-12 | Common Crawl Robots.txt Denials Nearly Doubled Since 2023 | New page: robots.txt denials in all 104 Common Crawl crawls since 2016 from Common Crawl crawl statistics (6.16% of fetch attempts in 2026 vs 3.39% in 2023; 193.2M in Sep 2026 crawl), one CSV. Linked from the AI opt-out survey and AI-Crawler Census. | |
| 2026-10-12 | MASQUE Tracker: 3 RFCs, 6 Active Drafts, Busiest Year Yet | New page: IETF Datatracker data on the MASQUE working group (17 drafts, 3 RFCs, 6 active drafts, 24 draft revisions in 2026 to 12 Oct), two CSVs. Linked from Web Bot Auth tracker and the home-internet supply chain. | |
| 2026-10-11 | AI Copyright Lawsuits: 97 Federal Dockets Since 2023 | New page: 97 federal copyright dockets whose complaints concern AI training, from CourtListener/RECAP (42 filed in 2026 to 8 Oct; 75 with no termination date), classified from complaint text; one CSV. Linked from the Scraping Law Hub and How Scraping Cases End. | |
| 2026-10-11 | Web Bot Auth Tracker: One IETF Draft, Three Open Milestones | New page: IETF Datatracker data on the Web Bot Auth working group (charter approved 23 Oct 2025, 12 drafts, 3 open milestones), with two CSVs. Linked from the AI opt-out survey and the AI-Crawler Census. | |
| 2026-10-11 | IPv4 Transfers 2012–2026: 63 Million Addresses in 2025 | New page: IPv4 transfers from the five RIR transfer logs, deduplicated (8,081 transfers / 63.3 million addresses in 2025; inter-registry share 6% to 40% since 2020); aggregates only, two CSVs. Linked from Proxy IP Claims vs the IPv4 Registry and Residential IP Supply by Country. | |
| 2026-10-11 | Tor Exit Relays Fell 11% in Four Days (October 2026) | New page: Tor Metrics daily Exit-flag counts (2020 – 9 Oct 2026) and an Onionoo snapshot of 2,703 running exits by country, autonomous system and relay family; two CSVs. Linked from Where Bot Traffic Comes From and the botnet timeline. | |
| 2026-10-11 | AI Chatbots in Chrome Rankings: Claude Into Top 1,000 | New page: Chrome UX Report rank buckets for 13 AI chatbots and 14 other AI sites at six snapshots (Sep 2023 – Aug 2026), with CSV. Linked from the AI-Crawler Census and the Wikipedia bot-traffic page. | |
| 2026-10-11 | CISA Exploited-Vulnerabilities List: 291 Edge-Device Entries | New page: CISA KEV catalog (8 Oct 2026 release) sorted into 291 edge-device entries (firewalls, VPN gateways, routers, small-office gear, cameras), with end-of-life notes and ransomware flags; CSV. Linked from the botnet timeline and the Home-Internet Supply Chain. | |
| 2026-10-11 | Wikipedia Bot Traffic: Automated Views Hit 55% of User Views | New page: Wikimedia pageviews API, automated vs user vs spider pageviews for all projects and English Wikipedia (Jan 2023 – Sep 2026), with CSV. Linked from the AI opt-out survey and Where Bot Traffic Comes From. | |
| 2026-10-08 | The AI Opt-Out Standard vs Real robots.txt Files | New page: robots.txt from the CrUX top 10,000 origins checked for the IETF aipref Content-Usage rule, Cloudflare Content-Signal and named AI-crawler blocks; status of the IETF drafts; Cloudflare’s 15 Sep changes. 2 CSVs. Linked from the AI-Crawler Census and the scraping-cases page. | |
| 2026-10-08 | LinkedIn v. ProAPIs: Scraping Case Ends in Consent Judgment | New page: the 16 Sep 2026 consent judgment in LinkedIn v. ProAPIs (court filings), how 18 federal scraping cases stand, and all 21 Federal Register documents mentioning “web scraping”, with 2 CSVs. Linked from the Scraping Law Hub and Bright Data’s Patents. | |
| 2026-10-08 | Proxy IP Claims vs the IPv4 Registry | New page: residential-IP claims for 41 countries compared with NRO delegated IPv4 (8 Oct 2026 file), with CSV. Linked from Residential IP Supply by Country and The Home-Internet Supply Chain. | |
| 2026-10-08 | New: reCAPTCHA vs Turnstile: The CAPTCHA Shift, 2022–2026. reCAPTCHA, Turnstile and hCaptcha shares in 12 HTTP Archive crawls, with rank and platform breakdowns and CSVs. | ||
| 2026-10-08 | New: The Week Scraping Rebranded for AI. Live GitHub stars and PyPI downloads for 17 scraping tools (Firecrawl 2.93× Scrapy’s stars), set against ScraperAPI, Oxylabs and Rayobyte announcements dated 6 October, with CSV. | ||
| 2026-10-08 | New: Bright Data’s Patents by the Numbers. 219 grants (2012–2025), continuation share vs all 2024 US grants, and all 38 PTAB reviews involving Bright Data and Oxylabs-group patents, with CSVs. | ||
| 2026-10-08 | NetNut | site | New report: NetNut, 98 Days After the FBI Seizure. On 8 October all five NetNut and Alarum domains we checked still showed the FBI seizure page; dated timeline of Alarum’s 7 SEC filings since 2 July (traffic pause, workforce cuts, class-action filings, delayed results), Gen’s count of about 474,000 idle Windows installs, Internet Archive captures and Chrome UX Report buckets. One CSV. |
| 2026-10-08 | — | site | New study: The Home-Internet Supply Chain Behind AI and Proxies. Chrome UX Report popularity buckets for bandwidth-sharing app dashboards and proxy sellers by country (August 2025 and August 2026), Rayobyte’s new $0.0095–$0.0150/GB Scale Residential prices against the $0.10/GB two apps say they pay, and Grass’s own payout figures. Company figures are their own statements. Two CSVs. |
| 2026-10-08 | Bright Data | correction | Corrected Residential IP Supply by Country. We had reported that Bright Data’s locations list showed exactly four times its country-page figures; the smaller number was the start value of an animated counter, and the larger one is Bright Data’s total across residential, ISP and datacenter IPs. The page now uses each counter’s residential figure (US: 3,727,713 residential, 6,493,229 ISP, 1,048,334 datacenter, rechecked 8 October 2026), which changed Bright Data’s figures for 37 countries. New CSVs, including the counter split. |
| 2026-10-02 | — | site | Retired the August 2026 Pricing Transparency Audit: /pricing-transparency/ now 301-redirects to the Proxy Pricing Transparency Report. Webshare’s August A grade (pass on discount framing) conflicts with the report’s archive check of its $7.00 struck-through price. The old grades and what changed are kept on the report. |
| 2026-10-02 | — | site | Added a contact page and a press & data requests line on every study page. Email [email protected] for corrections, press and data requests. |
| 2026-10-02 | — | site | New study: Where Bot Traffic Comes From. Source countries of 26.5 million attacks recorded by one university honeypot network (CSIRT-UPJS), November 2024–April 2025 and July–December 2025, from two CC BY 4.0 datasets. Two CSVs. |
| 2026-10-02 | — | site | New study: Residential IP Supply by Country. Per-country residential IP figures published by 10 of 14 providers (sites captured 2 October 2026), set against World Bank/ITU internet users, broadband and mobile subscriptions for 41 countries. Provider claims, not verified pool sizes. Two CSVs. |
| 2026-10-02 | — | site | New study: Proxy & Scraping Search Demand Report. Estimated Google search volumes for 87 proxy, scraping, AI-scraping, anti-bot and brand keywords, October 2022–August 2026, worldwide and in 24 countries including the US (Google Ads data via DataForSEO; Google Trends cited separately), with three CSVs. |
| 2026-10-02 | — | site | New study: The Scraping Workforce. US employment and wages for 10 web-data occupations, May 2021–May 2025 (BLS OEWS, O*NET 31.0), with state pay rankings and two CSVs. |
| 2026-10-02 | — | site | New study: Anti-Bot vs Proxy Patents. It covers US patents and published applications on bot detection, browser and device fingerprinting, CAPTCHA and residential proxies / IP rotation, built from USPTO PatentsView data (through 2025) and USPTO Open Data Portal searches for 2026. It includes patents assigned to proxy-network companies, the top patent owners, notable patents, the method, caveats and two CSV downloads. |
| 2026-10-02 | all | price | Site-wide price sync: 52 pages (the /best/ rankings, provider profiles, comparisons, alternatives and guides) re-checked against providers’ pricing pages on 2026-10-02. Changes: IPRoyal’s $7.00/$5.95/$5.25 tiers relabelled as subscription prices (pay-as-you-go is $7.35/$6.25/$5.51/GB); Apify Starter $29 → $19/mo; ScrapingBee’s new $19 Hobby plan (75k credits) added; Oxylabs residential plans now $6/GB (Starter 5GB) to $2.50/GB (Corporate 1TB); Rayobyte mobile now $3/GB down to $0.95/GB (was “as low as $0.50”); SOAX Tier 2 and Tier 3 ranges updated (Tier 3 from $0.35, was $0.25); Decodo’s $8.50 figure removed (no longer published). Confirmed unchanged: the “datacenter from $0.30/GB” rate (Rayobyte pay-as-you-go, 2–50 GB), DataImpulse, Webshare, Bright Data, Proxy-Seller, Proxy-Cheap, NodeMaven and Scrape.do. The Price Index remains the dated 2026-08-07 baseline snapshot. |
| 2026-10-02 | — | site | New free tool: What’s my IP? Proxy & VPN checker. It shows your IP address, ASN, and DB-IP country, and whether the address is on open cloud, datacenter, VPN, Tor-exit or iCloud Private Relay lists. Built from data published on 2026-10-02; sources and licences are listed on the page. |
| 2026-10-02 | — | site | Proxy cost calculator synced to rates read from 11 providers’ pricing pages on 2026-10-02 (same data as the embeddable widget). Notable changes since 2026-08-07: ProxyEmpire and NodeMaven now publish plan ladders (ProxyEmpire pay-as-you-go $3.50/GB), Oxylabs publishes plans from $6/GB down to $2.50/GB at 1TB, ScrapingBee added a $19 Hobby plan, and the datacenter comparison now uses DataImpulse’s published $0.50/GB. |
| 2026-10-02 | — | site | Embeddable proxy cost calculator widget launched. Its residential rates were read from 11 providers’ pricing pages on 2026-10-02 (NetNut excluded). |
| 2026-10-02 | NetNut | site | Status check: netnut.io still shows an FBI seizure notice; Alarum announced a temporary operational pause on 2026-07-04. No public announcement of charges found. NetNut status notes added to its profile, alternatives and comparison pages; an unsourced description of Alarum’s response replaced site-wide with its filed statements. See botnet & takedown timeline. |
| 2026-08-07 | all | price | Baseline pricing verification: 15 of 19 providers recorded from live pricing pages. Storm Proxies/ScraperAPI/Zyte pending browser check; Oxylabs starting prices only. |
| 2026-08-07 | — | site | ProxyPicker project started: architecture defined, provider set selected, WordPress scaffold created. |
| 2026-07-02 | NetNut | site | FBI seized NetNut-associated domains in an action coordinated with Google (GTIG describes the network as also known as Popa, at least 2M devices). Parent Alarum said it was cooperating with law enforcement. NetNut removed from all rankings. Sources: Krebs on Security, SecurityWeek, The Register, Alarum 6-K. |