Thanks for your efforts and keep up the good work!
Thanks for your efforts and keep up the good work!
Posted Jul 10, 2026 17:46 UTC (Fri) by wtarreau (subscriber, #51152)In reply to: Thanks for your efforts and keep up the good work! by daroc
Parent article: An update on the scraper situation
> The central registry you propose sort of exists in the form of Common Crawl: https://commoncrawl.org/
Oh, thanks for the link, I wasn't aware. I'll try to make sure not to block that one!