Why not clone?
Why not clone?
Posted Sep 10, 2026 8:02 UTC (Thu) by anton (subscriber, #25547)In reply to: Why not clone? by raven667
Parent article: Ryabitsev: Creepy crawlies
Yes, it only works if the scrapers really only do what a browser with JavaScript enabled does. And if this defense gains any popularity, the scrapers will look at the non-JS path. Blocking IPs that follow the JS path is probably not what we want:
-
Scrapers will probably use a different IP for following the non-JS path (if they follow it).
-
Humans who read on the JS path a graphic that says "Please access this page again with JS disabled to see its content" will actually access the non-JS path from the same IP.