Volume difference with older crawlers?
Volume difference with older crawlers?
Posted Feb 17, 2026 14:37 UTC (Tue) by anselm (subscriber, #2796)In reply to: Volume difference with older crawlers? by marcH
Parent article: Poisoning scraperbots with iocaine
If you're a user of $AI_COMPANY's free offerings, it probably says somewhere in the 700-page license agreement (that you didn't read when you signed up for the service) that you consent to your computer serving as a proxy for $AI_COMPANY's web crawler .