CloudFlare spent years fighting scrapers and selling anti-bot protection.
Now they launched a /crawl API that can scrape an entire website with one request.
Only Claws will love it.
Introducing the new /crawl endpoint - one API call and an entire site crawled.
No scripts. No browser management. Just the content in HTML, Markdown, or JSON.