Volume difference with older crawlers?
Volume difference with older crawlers?
Posted Feb 17, 2026 16:55 UTC (Tue) by marcH (subscriber, #57642)In reply to: Volume difference with older crawlers? by paulj
Parent article: Poisoning scraperbots with iocaine
Thanks! But... if lessons from blatant copyright violations are any indication, I'm afraid they will somehow get away with that too. "Move fast and break things" etc.
Right now they seem rich and powerful enough to dominate that _other_ oligopoly that was rich, powerful and corrupt enough to extend copyright laws to 70 years after the death of the author (lol). That's apparently achieved through a combination of forced "partnerships", buy-outs and other nasty arm-wrestling.
Exactly like with email, who cares about the small players.
Unless... the whole Ponzi scheme falls apart first. Interesting times either way.
The LWN site is currently under high scraper load, so comment display has been suppressed for anonymous users. If you are a human, you may read the comments by clicking the button below:
Note: you can avoid this step in the future by logging into your LWN account.