All tags
Bot Protection
The defensive half of the scraping story. These posts look at how captchas and bot management decide who gets through, what Cloudflare's AI crawler controls changed in practice, and where paid crawling access is heading. Written from the side that had to keep collecting data without breaking anything.
3 posts
Cloudflare Launches a Scraping API That Respects Bot Protection
Cloudflare's new /crawl endpoint built on Browser Rendering won't bypass CAPTCHAs or CDN bot protection - and that's exactly the point. Here's why this could be a bigger disruption than the technology itself.
Pay Per Crawl - Cloudflare VS AI Crawling
Discover how Cloudflare’s new bot-blocking and Pay Per Crawl features aim to protect content, fight AI scrapers, and help creators earn from their data.
AI Labyrinth - AI vs AI in Web Scraping
Will AI Labyrinth, Cloudflare's new antibot feature, disrupt web scraping and crawling?