|
|
Log in / Subscribe / Register

Haha, AI can't do $THING

Haha, AI can't do $THING

Posted Jun 2, 2026 10:16 UTC (Tue) by NYKevin (subscriber, #129325)
In reply to: Haha, AI can't do $THING by dskoll
Parent article: Nesbitt: Protestware for coding agents

> Sure, AI can do all of those things, but the dirty (not so) secret is it can only do it because it has had a large corpus of human creations to steal.

I have heard this argument before, and I've thought very carefully about it.[0] Regardless of your feelings on the morality, I think the law as it is currently structured is unprepared to recognize this as "theft" (or infringement, or whatever you want to call it).

To understand why, we need to go back to the 17th century. Copyright law is a brand-new idea, and we need to codify how it works. You *could* write something like "don't rip off other people's books etc. using a movable type printing press." But then you'd have to update the law every time a new printing technology is invented, and that'd leave a lot of authors (and other artists) unprotected in the meantime.

Instead, they wrote something more like "don't rip off other people's books etc. using any technology that exists or will ever exist." In modern terms, the law is technology neutral.[1] For the last ~300 years, this has worked out pretty well in practice. Technologies come and go, and the law adapts. But we don't get this flexibility for free. Judges and lawyers have to figure it out on a case-by-case basis, and they need a coherent theory of how that works. That theory is now the problem.

Broadly and informally speaking, most analysis of infringement uses a black-box model. That is, instead of focusing on the specifics of how the technology works, it focuses on the inputs and outputs to the process. For example, when file sharing gets invented, and pirates argue in court that e.g. "BitTorrent only shares small pieces of the work at any one time," judges can make short shrift of that argument. The overall effect is to make and distribute copies of the work, so it's infringing. We don't need to care about the details of the BitTorrent protocol (nor any of the other file sharing apps). We just look at inputs and outputs, and in that view, the file sharing app looks functionally identical to a copying machine.

But AI opens a can of worms, because its inputs and outputs do not look much like classic infringement, at least in some cases. Sure, there are situations where the AI produces an output that looks like Mickey Mouse or another copyrighted character. Those are easily litigated and somebody probably loses (the main open question is whether that "somebody" should be the AI company or the end user who generated the image). But there are also situations where the AI's output is not substantially similar[2] to any individual training image. The law has seen that fact pattern before. It looks very much like the inputs and outputs you get from a student learning to draw or write.

Obviously, the learning process of an AI is quite different to the learning process of a human. But if you're black-boxing that process away, then you don't care. You look at the inputs and outputs, conclude that the AI's training is broadly similar to something that has been legal for three centuries, and dismiss the case.

So that leaves the question of what to do about it. I think there are broadly three paths that the law could take:

0. Do nothing, and accept that AI is (probably) legal in some applications.
1. Modify the law to carve out the specific kind of mimicry that AI performs, while still being technology-neutral in principle.
2. Modify the law to treat AI differently from other technologies.

(1) is probably impossible. The distinctions between the inputs and outputs created by an AI on the one hand, and a human art student on the other, are too fine for judges to reliably analyze in the courtroom. More importantly, there are many other edge cases that we would need to exclude, such as making sure that the Tolkien estate does not accidentally gain ownership over the entire genre of high fantasy. And of course, AI is rapidly evolving technology and any "AI fingerprint" we identify now will probably be worthless in six months.

(0) is obviously workable (regardless of its merits), so needs no further analysis. That leaves us with (2) to consider. The problem with (2) is that it turns the law into a game of Whac-a-Mole. Legislators will write up some description of how AI works, and then a few months later, some startup will find a way to make an AI-like-thing that doesn't quite fit the legal definition. This repeats until lawmakers get tired of it, and then we're back to (0).

Alternatively, we end up with a definition so broad that it covers some non-AI technologies such as procedural generation. Would Minecraft infringe just because some of its terrain generation loosely resembles some famous landscape paintings? Most of those paintings are in the public domain, so I suppose not, but that feels like a scary question to even have to ask. Tech neutrality is the seal that holds back these bizarre and awkward questions, and breaching that seal leaves us in a world of confusion.

--

[0]: Disclaimer: I work for big tech and have both monetary and job-related biases in favor of AI. All opinions are my own.
[1]: The law is technology neutral on the question of infringement. It's not neutral on other questions, such as the threshold of originality, but we're not talking about that (yet).
[2]: See https://en.wikipedia.org/wiki/Substantial_similarity and references linked from there.


to post comments

Haha, AI can't do $THING

Posted Jun 3, 2026 12:41 UTC (Wed) by marcH (subscriber, #57642) [Link] (1 responses)

> The distinctions between the inputs and outputs created by an AI on the one hand, and a human art student on the other, are too fine for judges to reliably analyze in the courtroom.

I don't understand why this comparison would be even looked at in the first place, it does not make sense to me.

A printing press can be used to infringe copyright - or not at all. That's why copyright uses a "black box" model: because the same user can sometimes be infringing, other times not at all and yet other times it's borderline and debatable. So copyright never had any other choice than this black box model. It could never care about the technology. It did try to attack some copy technologies sometimes but that never made sense and never worked.

A student can produce a drawing too similar and copyrighted - or not at all. Sometimes they will infringe and others not.

Exact same thing for AI output. There is no simple AI rule and there cannot be. It's still case-by-case.

> Technologies come and go, and the law adapts. But we don't get this flexibility for free. Judges and lawyers have to figure it out on a case-by-case basis, and they need a coherent theory of how that works. That theory is now the problem.
> Broadly and informally speaking, most analysis of infringement uses a black-box model...

That inability to scale has not changed. The only thing that changed is the _volume_ copyright infringement must now face. Copyright enforcement never "scaled". AI made that inability much more obvious but did not fundamentally changed the initial design flaw.

In a recent past, BitTorrent and friends already exposed another, different inability of copyright enforcement to scale. That inability was never "fixed". It was only mitigated through various means: targeting only the biggest offenders, threats, offering better, legal streaming alternatives...

One difference with today's AI challenge is not just the volume of infringements but also the very deep pockets of AI companies who can buy even more congressmen (thank you "Citizens" United vs FEC) than the copyright lobby can. Again: a scaling issue.

So maybe this is finally the end of copyright, dunno. But not because AI affected any of copyright's fundamental logic, but rather because it was never designed to scale in the first place - as you wrote yourself.

Haha, AI can't do $THING

Posted Jun 3, 2026 18:27 UTC (Wed) by NYKevin (subscriber, #129325) [Link]

> I don't understand why this comparison would be even looked at in the first place, it does not make sense to me.

I will admit that it has been the subject of some controversy. Compare and contrast Bartz v. Anthropic and Kadrey v. Meta (which criticized the reasoning in Bartz). But real federal judges are taking this argument seriously, so artists should as well.

https://docs.justia.com/cases/federal/district-courts/cal...
https://law.justia.com/cases/federal/district-courts/cali...


Copyright © 2026, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds