|
|
Log in / Subscribe / Register

Collateral damage

Collateral damage

Posted Aug 29, 2026 17:00 UTC (Sat) by mb (subscriber, #50428)
In reply to: Collateral damage by hDF
Parent article: Ryabitsev: Creepy crawlies

It's pretty upsetting when it gets blocked

It's equally upsetting, though, if my infrastructure that I pay money for is being DDoSed. Therefore, I (try to) block people who misuse my services. It's as simple as that.

And yes, an AI agent scraping cgit (or similar interfaces) is a misuse, exactly like an AI crawler scraping cgit is a misuse. This is nothing new. It dates back to the 90s that heavy and scripted use of web APIs is considered misuse and such people have always been blocked.

If you don't like being blocked, tell your AI agent to be a polite "citizen", slow down and behave like a human reading the page.


to post comments

Collateral damage

Posted Aug 29, 2026 23:02 UTC (Sat) by JanC_ (subscriber, #34940) [Link]

Or use the API instead of crawling a zillion of different re-representations of the same info on the web.


Copyright © 2026, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds