|
|
Log in / Subscribe / Register

LLMs are just tools

LLMs are just tools

Posted Jun 4, 2026 0:31 UTC (Thu) by gerdesj (subscriber, #5446)
Parent article: Tridgell: rsync and outrage

I think LLMs can be useful but not in the way that the likes of MS n that would like.

The sheer cost of running a fully tooled up LLM that knows "everything" and thinking you can sell it to everyone at cost plus margin is as daft as thinking you can sell an encyclopedia to every household.

The real utility (I think) of these beasts is in smaller, focused efforts. Qwen 3.6 35B (quantized to 4 bit) can run on an elderly NVIDIA RTX A4000 with 16GB of GPU RAM using llama.cpp. I found another use for my Veeam and others backup boxes - RAM etc was rather cheaper a few years back!

I treat it exactly the same as I do carpentry. I can cut a 10' line through, say, 18mm plywood to within better than a 1mm (0.5mm either side) tolerance with a panel saw, if I am careful. With a table saw I can do better but the cut will be wider and with a rotary saw I will generally want a long guide and it will also be wider. The table saw and rotary saw will always best me for vertical, when set correctly. I do my best - I use my dominant eye to sight and I set myself physically as "square" as possible to the work piece. A panel saw is pretty good at staying square - if it starts to flex then you are going off track!

Hopefully the analogy is not lost on anyone.

When you use a tool you need to know how to get the best out of it. Ignore "magic" thinking (prompt optimisation and other wankery) and instead accept that the answers you get back might be a bit wrong.


to post comments

LLMs are just tools

Posted Jun 4, 2026 4:28 UTC (Thu) by szm (guest, #100120) [Link] (2 responses)

Thank you for your very level-headed comment, I really like your tool analogy!

The way I see it, wide-scale, heavily subsidized and somewhat naive[1] use of LLMs has removed all of a sudden a lot of friction from within systems and processes. Removing friction sounds great if you want to move faster and get things done more quickly. But try walking without friction. Heck, try stopping without friction, it can be exhilarating. Or terrifying, depending on how much you prefer not to break your limbs. A few months ago, I suddenly noticed that the street where I live is actually quite steeply sloped downhill. Coincidentally, I arrived at this conclusion while trying to cross it when there was suddenly a lot of black ice covering it end to end. Never had to do the kind of "swing-by a lamp post and use the neighbors trashcan as a sort of angular momentum barrier" maneuver before. And I hope to not have to do it again. It made me appreciate friction a lot more.

The habits, processes, systems, and culture we are living with and in to create the things that are important to us have been established over a long period of time when friction was there. For better or worse, we have actually built the stuff we rely on with the inherent friction in mind. It is kinda insane (and frankly bewildering) to me that we expect systems that have been calibrated with and around friction to suddenly adapt to environments with a lot less friction involved. It is also somewhat sad to see people denying that there are downsides of suddenly switching it effectively off (or replacing it with frictions that are different, like "I can't justify the expenses of buying computer hardware to hack anymore because the world has gone crazy, so some projects I wanted to do are now on the back-burner") and pretending that there is no moral or ethical component to the wide scale shifting of habits, processes, systems, and culture. :shrug:, I guess?

Cheers,
szm

[1] As in "build unfathomable capacity with no regard for economic sense, ecological restrictions, ethical concerns and other "boring" things that start with the letter e; unleash it on society without discussion and deliberation or even a plan except to somehow either brute force your way to something akin to "AGI" and/or to maximise profits" naive.

LLMs are just tools

Posted Jun 4, 2026 14:17 UTC (Thu) by Kluge (subscriber, #2881) [Link] (1 responses)

This is an excellent analogy.

LLMs are just tools

Posted Jun 4, 2026 21:38 UTC (Thu) by sionescu (subscriber, #59410) [Link]

And wrong, as is all thinking by analogy.


Copyright © 2026, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds