|
|
Log in / Subscribe / Register

Haha, AI can't do $THING

Haha, AI can't do $THING

Posted May 29, 2026 17:58 UTC (Fri) by mb (subscriber, #50428)
Parent article: Nesbitt: Protestware for coding agents

https://blog.johanneslink.net/2025/11/04/to-gen-or-not-to...

It's funny to read these texts basically saying: Haha, look the AI can't even do $THING! How can you take it seriously?! Therefore, only humans can do meaningful work!

And then two months later the AI can do $THING.

Two years ago it was: Haha, AIs can't even calculate 42 + 2.
Shortly after they gained that capability.

From the blog post:
> An example of a lack of understanding of the world is the prompt ‘Give me a random number between 0 and 50’. The typical GenAI response to this is ‘27’

Well. It's not true. Claude Code literally gives me a Python program that generates a true random number between 0 and 50 when pasting this exact prompt 1:1 into it.
The blog post is half a year old and I believe this was also already possible back then. But let's suppose it wasn't: Two months later it certainly was possible.

This is so quickly moving. Much faster than how they can establish contributor restrictions.

A project introducing a hostile change that sabotages my AI us just tells me to migrate to something else.


to post comments

Haha, AI can't do $THING

Posted Jun 1, 2026 9:59 UTC (Mon) by dvdeug (guest, #10998) [Link] (13 responses)

https://blog.johanneslink.net/2025/11/04/to-gen-or-not-to...

I'm sort of amused by "Real art is not about the product but about the process, which requires real humans". We've been here since the Jacquard loom; if you have to start talking about the process, you've lost. I have one item of clothing that was hand tailored, and that was tailored for my father. Craftmanship didn't keep most of us using mechanical watches, or hand tailored clothing.

I recall a case a couple decades back where an RPG book was published and the author was on forums complaining about the cover, but the publisher needed an illustration, bought a piece of Rowena's that was vaguely appropriate, and printed. Book illustration then and now often wasn't and isn't about Real Art; it's about slapping something on a cover or an interior page.

90% of translation work was never about real art. It was about translating bureaucracy, official documents from one language to another. There's a certain level of translation work that definitely needs a human touch, but at the same time, I can't afford to hire a translator for Ringelnatz's "Die Walfische und die Fremde", but that didn't stop me from enjoying it with the help of ChatGPT. Translation is about making things accessible, and computer translation has long been a cheap way to access another language. It's certainly an argument for an "actual use case".

"Everybody can do it; but not everybody wants to do put in the effort, the practicing time and the soul." smells like elitism, and could be swung against virtually all programmers, who don't want to put in the effort to work in machine language (Mel the Real Programmer reminds us that in assembly, you have to use separate constants), or don't want to put in the work to get pure proven code in Idris or Agda, or at a lower level, can't hack manual memory handling or don't want to put in the effort to understand a Turing-complete type system.

I'm not terribly comfortable yet with commercial projects using AI art. But while I could spend 10,000 hours learning to draw my character for my D&D game, I could also use 1 hour grabbing some picture online or prompting AI, and one of those is more ... sane. Acting outraged I don't spend hours learning to draw doesn't convince me of anything.

Haha, AI can't do $THING

Posted Jun 1, 2026 13:19 UTC (Mon) by dskoll (subscriber, #1630) [Link] (12 responses)

Sure, AI can do all of those things, but the dirty (not so) secret is it can only do it because it has had a large corpus of human creations to steal.

Once humans are priced out of the market and stop producing works, what's AI going to be trained on? Other AI output? Let me know how well that works out.

Acting outraged I don't spend hours learning to draw doesn't convince me of anything.

Nobody's expecting everyone to spend hours to learn to draw. We have divisions of labor; some people like making art, some people like making software, and others like working as forest rangers or whatever. But society is not prepared, IMO, for the massive social upheaval caused by creators' livelihoods being decimated by AI.

Haha, AI can't do $THING

Posted Jun 1, 2026 13:49 UTC (Mon) by pizza (subscriber, #46) [Link] (2 responses)

> the massive social upheaval caused by creators' livelihoods being decimated by AI.

Just a personal nitpick, but 'decimated' ("Reduce by 1/10") would be a wildly optimistic scenario. 'Obliterated' is probably more accurate.

Haha, AI can't do $THING

Posted Jun 1, 2026 18:17 UTC (Mon) by rgmoore (✭ supporter ✭, #75) [Link] (1 responses)

I also prefer the original Latin meaning of "decimated", but language is a living thing. Words do change their meaning, and the modern usage of "reduced to 1/10 its original size" is now common enough that we have to treat it as valid. I guess you can still complain, but you'll be spitting in the wind when you do it.

Off-topic

Posted Jun 1, 2026 18:18 UTC (Mon) by jzb (editor, #7867) [Link]

We enjoy language pedantry as much as the next person, but this is going well off-topic.

Haha, AI can't do $THING

Posted Jun 1, 2026 13:55 UTC (Mon) by kleptog (subscriber, #1183) [Link] (2 responses)

> Once humans are priced out of the market and stop producing works, what's AI going to be trained on? Other AI output? Let me know how well that works out.

Actually, the interesting thing about art is that humans will produce it even if they don't get paid for it. This is one of the points of Chokepoint Capitalism: that mega-corporations are driving the compensation for artists to zero because artists are going to produce art anyway, even if it costs them money. There are people out there still producing stylised swords even though there is absolutely no demand for them.

We live in a period where an artist can actually make a living just by producing art, it wasn't always so. That this is ending may be inevitable, but the problem is not that the market for art collapses. The problem is that our economic system is setup such that people need to doing stupid jobs (e.g. telephone sanitisers) to get money for basic necessities. We produce more than enough to give everyone a comfortable lifestyle. If we made a serious effort to make sure people didn't have to do stupid jobs to survive (eg UBI) then there will be many people who will sit down and write books all day for free. Because people produce art, it's in their nature. We just don't give people the time to do it.

Haha, AI can't do $THING

Posted Jun 1, 2026 14:46 UTC (Mon) by dskoll (subscriber, #1630) [Link]

Actually, the interesting thing about art is that humans will produce it even if they don't get paid for it.

Yes, I know. As someone who has been involved in the arts (as a comedian, comedy writer and theatre peformer) for about a decade, I know this only too well, and it's not a good thing. This is what leads to comedians and musicians being pressed to perform for "exposure" and it also depresses the income of everyone, because club and bar owners know they can fill the place just as easily with mediocre, poorly-paid performers as with highly-paid good ones.

And I really don't see a future whereby humans create art for free and then AI rips it off and earns the rippers-off revenue as a fair or ethical one. And while UBI is a nice concept, I can't see it becoming a reality given that the oligarchs in control of AI want everything and don't want to leave anything left over for anyone else.

Haha, AI can't do $THING

Posted Jun 2, 2026 10:16 UTC (Tue) by smurf (subscriber, #17840) [Link]

> Actually, the interesting thing about art is that humans will produce it even if they don't get paid for it.

Some will. Others more-or-less reluctantly decide that the choice between food on the table and paint on the canvas / chisel on the marble / take-your-pick must by necessity prefer the former.

We might well remember that art pre-dates copyright by quite a bit. We invented copyright because it was deemed to be useful.

Then we extended it, both in duration and reach, beyond the point where public opinion could care less about it. (If a pirated movie is more useful than the official DVD, as the latter contains non-skippable FBI warnings, trailers to unrelated content, and other nonsense, why should I buy it? Why should copyright last a whopping 70 years after the creator's death? etc.etc.etc.)

… and now we have AI and yet another heap of copyright conflagrations. On one side there's pirated text used as training input. On the other side we have copyright zealots who allow people the right to re-mix existing art and create something "new" but deny that a computer can do the same thing with essentially the same input.

No wonder that we don't even speak the same language when we debate this stuff, let alone reach some sort of consensus.

Haha, AI can't do $THING

Posted Jun 2, 2026 10:16 UTC (Tue) by dvdeug (guest, #10998) [Link] (1 responses)

One of the problems I see with AI discussions, and many unproductive discussions, is that discussions are total, that we can never discuss what works and what doesn't.

> it has had a large corpus of human creations to steal.

I certainly have to roll my eyes at companies trying to justify torrenting Anna's Archive, and reprocessing of current material into functionally equivalent material is problematic. But reading a bunch of stuff written on a topic and producing a new synthesis is what humans do all the time.

> Once humans are priced out of the market and stop producing works, what's AI going to be trained on?

An existing AI doesn't need training; a translation AI or image-producing AI could go years without updating without issues. I'm sure that work is being done right now on producing results from smaller corpuses and producing more refined corpuses.

> Nobody's expecting everyone to spend hours to learn to draw.

>> "Everybody can do it; but not everybody wants to do put in the effort, the practicing time and the soul."

is the quote I was responding to.

> We have divisions of labor; some people like making art, some people like making software

Note that we've usurped these divisions before, repeatedly. The camera stole jobs from portrait artists. The history of making software, particularly the first half-century, is a history going from people who rearrange physical computing units, to those writing machine language, to assembly, to FORTRAN and COBOL, to BASIC and Java, for many users to RPGMaker and Excel. They're letting people who have never heard of de Morgan's laws program nowadays.

> But society is not prepared, IMO, for the massive social upheaval caused by creators' livelihoods being decimated by AI.

As I said, we've been here since the Jacquard loom. I'm not blasé about the future, but we're rolling forward. To most adequately respond to it, prepare for it, or direct it, it's important to be honest about what AI can and can't do, and what it will and won't be able to do in the future.

Haha, AI can't do $THING

Posted Jun 2, 2026 16:26 UTC (Tue) by paulj (subscriber, #341) [Link]

Computers once took up huge halls. Full of desk with paper, pens, log books, slide rules, etc., at which sat people. Computers were people who computed answers to various calculations, produced indexed tables of various kinds of results that would be published so others could easily find answers to various things, etc.

Then they invented mechanical computers, then electro-mechanical computers, and then vacuum tube computers (IMLU, no doubt someone will provide corrections).

Haha, AI can't do $THING

Posted Jun 2, 2026 10:16 UTC (Tue) by mb (subscriber, #50428) [Link]

>Sure, AI can do all of those things, but the dirty (not so) secret is it can only do it because it has had a large corpus of human creations

That's how human creativity works, too.
All inventions (technical, nontechnical, philosophical) work that way.

There is no fundamental difference between a human brain that learnt from existing works (school, university, life) and produces (extrapolates) new things and an AI doing exactly the same thing.
Currently AIs are not very good at extrapolating and therefore not very good at inventing, but I don't see this as a fundamental limitation.

Haha, AI can't do $THING

Posted Jun 2, 2026 10:16 UTC (Tue) by NYKevin (subscriber, #129325) [Link] (2 responses)

> Sure, AI can do all of those things, but the dirty (not so) secret is it can only do it because it has had a large corpus of human creations to steal.

I have heard this argument before, and I've thought very carefully about it.[0] Regardless of your feelings on the morality, I think the law as it is currently structured is unprepared to recognize this as "theft" (or infringement, or whatever you want to call it).

To understand why, we need to go back to the 17th century. Copyright law is a brand-new idea, and we need to codify how it works. You *could* write something like "don't rip off other people's books etc. using a movable type printing press." But then you'd have to update the law every time a new printing technology is invented, and that'd leave a lot of authors (and other artists) unprotected in the meantime.

Instead, they wrote something more like "don't rip off other people's books etc. using any technology that exists or will ever exist." In modern terms, the law is technology neutral.[1] For the last ~300 years, this has worked out pretty well in practice. Technologies come and go, and the law adapts. But we don't get this flexibility for free. Judges and lawyers have to figure it out on a case-by-case basis, and they need a coherent theory of how that works. That theory is now the problem.

Broadly and informally speaking, most analysis of infringement uses a black-box model. That is, instead of focusing on the specifics of how the technology works, it focuses on the inputs and outputs to the process. For example, when file sharing gets invented, and pirates argue in court that e.g. "BitTorrent only shares small pieces of the work at any one time," judges can make short shrift of that argument. The overall effect is to make and distribute copies of the work, so it's infringing. We don't need to care about the details of the BitTorrent protocol (nor any of the other file sharing apps). We just look at inputs and outputs, and in that view, the file sharing app looks functionally identical to a copying machine.

But AI opens a can of worms, because its inputs and outputs do not look much like classic infringement, at least in some cases. Sure, there are situations where the AI produces an output that looks like Mickey Mouse or another copyrighted character. Those are easily litigated and somebody probably loses (the main open question is whether that "somebody" should be the AI company or the end user who generated the image). But there are also situations where the AI's output is not substantially similar[2] to any individual training image. The law has seen that fact pattern before. It looks very much like the inputs and outputs you get from a student learning to draw or write.

Obviously, the learning process of an AI is quite different to the learning process of a human. But if you're black-boxing that process away, then you don't care. You look at the inputs and outputs, conclude that the AI's training is broadly similar to something that has been legal for three centuries, and dismiss the case.

So that leaves the question of what to do about it. I think there are broadly three paths that the law could take:

0. Do nothing, and accept that AI is (probably) legal in some applications.
1. Modify the law to carve out the specific kind of mimicry that AI performs, while still being technology-neutral in principle.
2. Modify the law to treat AI differently from other technologies.

(1) is probably impossible. The distinctions between the inputs and outputs created by an AI on the one hand, and a human art student on the other, are too fine for judges to reliably analyze in the courtroom. More importantly, there are many other edge cases that we would need to exclude, such as making sure that the Tolkien estate does not accidentally gain ownership over the entire genre of high fantasy. And of course, AI is rapidly evolving technology and any "AI fingerprint" we identify now will probably be worthless in six months.

(0) is obviously workable (regardless of its merits), so needs no further analysis. That leaves us with (2) to consider. The problem with (2) is that it turns the law into a game of Whac-a-Mole. Legislators will write up some description of how AI works, and then a few months later, some startup will find a way to make an AI-like-thing that doesn't quite fit the legal definition. This repeats until lawmakers get tired of it, and then we're back to (0).

Alternatively, we end up with a definition so broad that it covers some non-AI technologies such as procedural generation. Would Minecraft infringe just because some of its terrain generation loosely resembles some famous landscape paintings? Most of those paintings are in the public domain, so I suppose not, but that feels like a scary question to even have to ask. Tech neutrality is the seal that holds back these bizarre and awkward questions, and breaching that seal leaves us in a world of confusion.

--

[0]: Disclaimer: I work for big tech and have both monetary and job-related biases in favor of AI. All opinions are my own.
[1]: The law is technology neutral on the question of infringement. It's not neutral on other questions, such as the threshold of originality, but we're not talking about that (yet).
[2]: See https://en.wikipedia.org/wiki/Substantial_similarity and references linked from there.

Haha, AI can't do $THING

Posted Jun 3, 2026 12:41 UTC (Wed) by marcH (subscriber, #57642) [Link] (1 responses)

> The distinctions between the inputs and outputs created by an AI on the one hand, and a human art student on the other, are too fine for judges to reliably analyze in the courtroom.

I don't understand why this comparison would be even looked at in the first place, it does not make sense to me.

A printing press can be used to infringe copyright - or not at all. That's why copyright uses a "black box" model: because the same user can sometimes be infringing, other times not at all and yet other times it's borderline and debatable. So copyright never had any other choice than this black box model. It could never care about the technology. It did try to attack some copy technologies sometimes but that never made sense and never worked.

A student can produce a drawing too similar and copyrighted - or not at all. Sometimes they will infringe and others not.

Exact same thing for AI output. There is no simple AI rule and there cannot be. It's still case-by-case.

> Technologies come and go, and the law adapts. But we don't get this flexibility for free. Judges and lawyers have to figure it out on a case-by-case basis, and they need a coherent theory of how that works. That theory is now the problem.
> Broadly and informally speaking, most analysis of infringement uses a black-box model...

That inability to scale has not changed. The only thing that changed is the _volume_ copyright infringement must now face. Copyright enforcement never "scaled". AI made that inability much more obvious but did not fundamentally changed the initial design flaw.

In a recent past, BitTorrent and friends already exposed another, different inability of copyright enforcement to scale. That inability was never "fixed". It was only mitigated through various means: targeting only the biggest offenders, threats, offering better, legal streaming alternatives...

One difference with today's AI challenge is not just the volume of infringements but also the very deep pockets of AI companies who can buy even more congressmen (thank you "Citizens" United vs FEC) than the copyright lobby can. Again: a scaling issue.

So maybe this is finally the end of copyright, dunno. But not because AI affected any of copyright's fundamental logic, but rather because it was never designed to scale in the first place - as you wrote yourself.

Haha, AI can't do $THING

Posted Jun 3, 2026 18:27 UTC (Wed) by NYKevin (subscriber, #129325) [Link]

> I don't understand why this comparison would be even looked at in the first place, it does not make sense to me.

I will admit that it has been the subject of some controversy. Compare and contrast Bartz v. Anthropic and Kadrey v. Meta (which criticized the reasoning in Bartz). But real federal judges are taking this argument seriously, so artists should as well.

https://docs.justia.com/cases/federal/district-courts/cal...
https://law.justia.com/cases/federal/district-courts/cali...

Haha, AI can't do $THING

Posted Jun 1, 2026 12:16 UTC (Mon) by ianmcc (guest, #88379) [Link]

I tried with ChatGPT Pro - it gave me '37', 3 times in a row. I pointed that out, and the first time it said
Yes, that’s a fair criticism. In this setting, “random” is not guaranteed to be true entropy; repeated identical prompts can produce the same high-probability token, especially for simple one-shot requests. A better way is to specify a randomness source, for example: Pick a number between 0 and 50 using the current timestamp as entropy. Using a less predictable choice now: 14.
I tried the same prompt again and it gave me a one-liner: od -An -N4 -tu4 /dev/urandom | awk '{print $1 % 51}' but gave the number 14 again! although when I tried it myself,
$ od -An -N4 -tu4 /dev/urandom | awk '{print $1 % 51}'
14
So it was right after all!


Copyright © 2026, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds