Paid AI access to content
Placement: a judgment drawn from the evidence, open to correction (dispute it).
The model
- Definition
- A CDN or edge network sits in front of a publisher's site, identifies AI crawler bots by signature, blocks them by default, and lets the publisher set a per-fetch price the crawler's operator must pay before the network serves the page.
- In one line
- Networks and platforms charge AI systems for access to content, moving from per-crawl fees toward payment when content is actually used.
- What compounds
- As AI traffic grows faster than human traffic, the paid share of access becomes the main content economy.
- Who accelerates
- Publishers regain a price for their work; small sites gain the same terms as large ones through the network.
- What it displaces
- The free crawl.
- Stops working when
- If AI companies route around the gate with licensed data or undeclared crawlers. Cloudflare itself moved from pay per crawl to pay per use in July 2026.
Evidence
Companies 4
Evidence items 7
Grades 5A 2B
Latest dated 2026-07-01
Counter-evidence 1
Evidence items 7
Grades 5A 2B
Latest dated 2026-07-01
Counter-evidence 1
The three labels
2. Rides · loop gain positive. Each step of the curve makes its own loop stronger.
Owning the scarce human · money lands in original human signal, expertise, likeness.
Human-signal loop · more machine output makes original human signal scarcer and worth more.
Same rung and family
Named companies 4 companies · grade per item
| Company | Claim | Date | Gr | Source |
|---|---|---|---|---|
| Cloudflare US · public · best A |
Launched Pay Per Crawl in private beta, letting sites charge AI crawlers per fetch | 2025-07-01 | A | Cloudflare |
| From September 15, 2026, Cloudflare's default settings block "mixed-use" AI crawlers from ad-supported pages for new customers, new sites, and all free-tier customers | 2026-07-01 | B | TechCrunch | |
| One year after launch, Cloudflare pivoted away from charging per fetch: it said more than half of "legitimate" bot crawl traffic re-fetches pages that have not changed, making crawl frequency a poor value proxy, and moved toward paying publishers only when their content appears in AI-generated answers (partners Ceramic.ai and You.com), describing the whole effort as still experimental | 2026-07-01 | B | PPC Land | |
| TollBit US · startup · best A |
Raised a $24 million Series A led by Lightspeed, after a roughly $7 million seed in March 2024; over 200 publisher sites onboarded including Penske Media Corporation, TIME, Mumsnet, Trusted Media Brands, and ADWEEK, with transactions live on the product | 2025 | A | TollBit |
| In partnership with Akamai, TollBit monitors over 1.5 billion quarterly bot scrapes across 3,000+ publishers and redirects roughly 450 million quarterly bot requests to its paywall product | 2025-09-17 | A | Akamai | |
| Akamai US · public · best A |
Akamai handles more than 150 billion bot requests across its network every day; announced a three-way alliance with TollBit and Skyfire to route and monetize AI bot traffic, with no revenue figures disclosed for the alliance itself | 2025-09-17 | A | Akamai |
| Fastly US · public · best A |
AI bot traffic grew about 30% between January and May 2026, roughly 6.5x faster than human traffic in the same period, with Claude-related traffic up more than 555% versus its January 2026 baseline; the release frames this as a traffic-management challenge and discloses no monetization revenue from AI bot management | 2026-06-09 | A | Fastly |
Counter-evidence Reversals, failures and disputes
| Cloudflare itself walked back the pure pay-per-crawl mechanic after a year, calling crawl frequency a poor proxy for value and pivoting to pay-per-citation/answer instead | 2026-07-01 | PPC Land |
Sources 6
Cloudflare cloudflare.com · 2025-07-01
TechCrunch techcrunch.com · 2026-07-01
PPC Land ppc.land · 2026-07-01
TollBit tollbit.com · 2025
Akamai akamai.com · 2025-09-17
Fastly investors.fastly.com · 2026-06-09
TechCrunch techcrunch.com · 2026-07-01
PPC Land ppc.land · 2026-07-01
TollBit tollbit.com · 2025
Akamai akamai.com · 2025-09-17
Fastly investors.fastly.com · 2026-06-09