Reasonable policy, a lot of people are still gaining experience with this stuff [LWN.net]

Reasonable policy, a lot of people are still gaining experience with this stuff

Posted Mar 10, 2026 19:44 UTC (Tue) by LtWorf (subscriber, #124958)
In reply to: Reasonable policy, a lot of people are still gaining experience with this stuff by koverstreet
Parent article: Debian decides not to decide on AI-generated contributions

Humans submitting realistic looking garbage aren't that many and will get bored. Machines doing that with budgets of several thousands dollars might be similar in principle but certainly not in the amount of damage they can do.

It's like comparing bow and arrow with a machine gun.

to post comments

Reasonable policy, a lot of people are still gaining experience with this stuff

Posted Mar 10, 2026 21:23 UTC (Tue) by Wol (subscriber, #4433) [Link]

What's worse, they compared humans working together to achieve an aim, and it only took a couple of saboteurs to completely ruin things.

Iirc they were reconstructing shredded Stasi documents, and found that a bunch of dedicated people could do a pretty good job, treating it like a jigsaw. But it only took one or two people deliberately muddling things up to make the others give up.

So if we've got big ABNIs muddling things up, the web is going to be pretty much destroyed in fairly short order. If we're lucky, they're going to make a big enough mess, quick enough, such that they'll go bust and disappear off the scene. The worry is they'll just become false prophets and conspiracy theorists, on a large enough scale to truly mess things up right royally.

Cheers,
Wol

Reasonable policy, a lot of people are still gaining experience with this stuff

Posted Mar 11, 2026 2:18 UTC (Wed) by koverstreet (✭ supporter ✭, #4296) [Link]

Honestly, I think people can use a good wake up call and stress test every now and then. Remember University of Minnesota?

People have a real tendency to get lax on engineering standards - "it's fiiiine, I know how everything works" - and get sloppy over time. *cough Linux kernel automated testing* - people like to go on autopilot, and that works until it doesn't.

But if you're using your head, LLMs are a godsend for all that tedious janitorial work that everyone likes to let slide.

And if you're doing all the work keeping the codebase documented, tested, organized, and you're migrating to Rust and maybe even thinking about formal verification, you'll find that the idiots with chainsaws have a hard time doing real damage.