Volume difference with older crawlers?
Volume difference with older crawlers?
Posted Feb 17, 2026 13:45 UTC (Tue) by marcH (subscriber, #57642)In reply to: Volume difference with older crawlers? by paulj
Parent article: Poisoning scraperbots with iocaine
I agree with the immorality but where exactly is the illegality of the abuse? Which "law of the internet" does an abusive, distributed crawler violate? Assuming you find some, what stops crawlers from avoiding those countries and to crawl only from other ones?
If they hijack unwilling client computers then sure, but do we have any indication that it is actually the case? If not then then what else? I mean on what grounds could anyone sue if not?
TCP/IP won against telcos because it was focused on the technical aspects, mostly ignoring the business/economical ones. Afraid that very old naivety is finally hurting a lot; way beyond SMTP.
