|
|
Subscribe / Log in / New account

Gentoo bans AI-created contributions

Gentoo bans AI-created contributions

Posted Apr 23, 2024 17:30 UTC (Tue) by Cyberax (✭ supporter ✭, #52523)
In reply to: Gentoo bans AI-created contributions by atnot
Parent article: Gentoo bans AI-created contributions

> Because, as pointed out, that's not true. The current pricing is subsidized under the assumption

No, it's not. I know financials of a couple of a small AI company, and model running is expensive, but it can be done profitably. It's not feasible if you're doing any of the ad-funded "user is the product" crap, but it's doable if your customers actually pay you.

> I think you may be underestimating how resource hungry these things are. Consider the person in another thread here who said they needed two 3090 GPUs to get acceptable output speed for programming. That's $2500 upfront and nearly 1kW continuous power draw just for some autocomplete. Datacenter inference systems will be somewhat more efficient, but the scale of hardware needed to perform these queries is just bonkers.

The power draw is not continuous, you only need to do computation when you're doing a query. This takes in total maybe for a minute or so within an hour. In the OpenAI case, a single hardware node is shared across multiple customers.

The main cost that is not covered is R&D (model training and engineering salary).

> You've answered your own question :) It's hard to imagine a more use friendly interface than a text chat, but there is currently no clear route to improvements there either.

Chat is not great for UI systems, actually. It's too low-level, and you need to do context imports periodically. Just as with any other service, you need application support in many cases. My email classifier is a bunch of scripts that run on my home server, and it's certainly not a good general-purpose solution.

> The so-called hallucination is just inherent and can not be solved.

There are thousands of very smart people working on solving it. I'm pretty sure they'll think of something that will be good enough for practical purposes.


to post comments


Copyright © 2025, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds