I do not see this traffic
I do not see this traffic
Posted Aug 29, 2026 17:23 UTC (Sat) by pizza (subscriber, #46)In reply to: I do not see this traffic by zdzichu
Parent article: Ryabitsev: Creepy crawlies
Lucky you.
Over the past month, 89% of the traffic on one site I administer is blocked before it ever gets to anubis. Of the stuff that gets through, about 50% is purely attributable to AI crawlers using residential proxies for one query apiece. Most of the rest is from random other, better-behaved crawlers. That one hosts a gerrit instance that only a handful of folks actively interact with; I'd be surprised if even 1% of the non-AI traffic load (ie of that 11%) is from humans.
Another site blocks about 75% of traffic before it gets to anubis. 80% of what's left is again purely attributable to residential-proxy scrapers. There's probably a higher proportion of what's left attributable to humans, but it's still in the low single-digit percentages (again, of the non-blocked 25%).
Meanwhile, my hosting costs are going to roughly double in a couple of months. If not for these countermeasures, I'd have to throw even more money at this just to stay on the air.
They are constantly re-scraping my words and my software, leaving me holding the bill.
A pox on all their houses.
