Practical use of LLMs
Practical use of LLMs
Posted Aug 8, 2025 15:52 UTC (Fri) by anselm (subscriber, #2796)In reply to: Practical use of LLMs by khim
Parent article: On the use of LLM assistants for kernel development
when LLM model is trained it “remembers” facts its “long-term memory”.
Not really. LLMs don't deal in facts, they deal in probabilities, as in “what word is most likely to complete this partial sentence/paragraph/text?” These probabilities can be skewed in various ways through training and prompting, but it is important to keep in mind that to an LLM, the world is essentially alphabet soup – it has no underlying body of abstract factual knowledge from which it could draw logical conclusions like we humans do.
LLMs can certainly produce results that seem impressive, but in the long run they're probably just a side branch on the path to actual AI. If you ask Sam Altman he will tell you that OpenAI is only a year or so (and a few tens of billions of dollars) away from “artificial general intelligence”, but he's been doing that for years now and it's very hard to see how that would work given what they've been doing so far.
