Is this a survey?
Is this a survey?
Posted Aug 19, 2025 11:15 UTC (Tue) by rweikusat2 (subscriber, #117920)Parent article: The State of Python 2025
Posted Aug 19, 2025 11:47 UTC (Tue)
by tux3 (subscriber, #101245)
[Link] (6 responses)
Everything else aside, I think you could find much better evidence to question AI agents. For instance the recent METR randomized controlled trial (RCT) where people thought AI made them 30% faster, when in fact they were 20% slower than the control group.
Is driving vastly simpler than a grand-master level at chess, evidenced by the fact that many more people can drive? For humans, certainly. But my mid-range phone from a decade ago is much stronger still than a grandmaster. The point here is that human abilities don't correlate to computer abilities. You can't use computer performance in one human task to guess the performance the computer will have in other tasks.
What you have here is good evidence that you should *ignore* hype. Merely reacting in the opposite direction means you are still being influenced by hype. What we should do is judge new things on their own merits, regardless of the noise.
Posted Aug 19, 2025 11:59 UTC (Tue)
by Wol (subscriber, #4433)
[Link]
But how can a statistical analysis of proximity (which is basically your LLM) achieve similar results to a whole bunch of dedicated wetware which is subjected to a whole bunch of integrity and fact checkers like your neighbourhood lion?
If an LLM doesn't recognise the signs of a hungry lion nearby, what are the consequences to it? If a human doesn't recognise the signs, it's not going to have the option of trying again ...
Cheers,
Posted Aug 19, 2025 12:33 UTC (Tue)
by fishface60 (subscriber, #88700)
[Link] (2 responses)
What you have here is good evidence that you should *ignore* fascism. Merely reacting in the opposite direction means you are still being influenced by fascism. What we should do is judge fascism on its own merits, regardless of the noise.
Apologies for the extreme analogy, I don't believe that using the various tools labelled as AI makes you a fascist despite the correlation that fascists seem to love them.
I have seen this argument twice today after having never encountered it before and I do not follow the conclusion.
Ignoring propaganda is surrendering to it because you are not the only target, and denouncement does more to combat it than calling to judge it on its own merits.
Posted Aug 19, 2025 13:05 UTC (Tue)
by tux3 (subscriber, #101245)
[Link]
Say a pharma company is trying to sell some pill; the ads that they run don't automatically mean the drug is bad. And certainly doesn't mean it's good. Sometimes they make reasonable drugs that work on 40% of people with acceptable side effect, sometimes they inexplicably push aducanumab through the FDA and you start hearing Latin chanting to the tune of "delenda est".
The takeaway isn't that we can't push back against marketing. Just that it's devoid of information. If you look at clinical studies and Cochrane reviews, you will learn something about the drug on its own merits. If you react negatively to the hype, you're following a rule of thumb that overhyped things tend to suck. That happens to be true most of the time, but at the end of the day you're still reacting to the random fluctuations of the advertising department, instead of the truth on its own merits.
Posted Aug 19, 2025 14:44 UTC (Tue)
by intelfx (subscriber, #130118)
[Link]
I believe you have just Godwin’d yourself.
Posted Aug 19, 2025 14:05 UTC (Tue)
by rweikusat2 (subscriber, #117920)
[Link] (1 responses)
I was pointing at the performance of people and not computers: They failed to solve a relatively simple task computers aren't particularly suited to. Hence, why would they succeed at a much more complicated task computers aren't particularly suited to, either?
Driving is obviously also vastly simpler than approximating PI with an accuracy of 107,3741,824 digits. But that's a task computers are suited to.
As the German saying goes: „Nicht alles, was hinkt, ist ein Vergleich.“
Posted Aug 19, 2025 14:21 UTC (Tue)
by pizza (subscriber, #46)
[Link]
Uh, no. the algorithms commonly used to derive Pi are *vastly* simpler than the multitude of parallel processes and tasks that factor into the activity "driving. Not to mention driving imposes hard real-time constraints, whereas calculating Pi does not.
Posted Aug 19, 2025 13:23 UTC (Tue)
by Otus (subscriber, #67685)
[Link] (1 responses)
The two domains are completely different. You can't fail at driving 10% or even 1% of the time without huge problems. But if you get good code 90% of the time you can work with that. (Sounds better than some developers I've worked with.)
That's not to say that you should use AI coding agents. I'm sceptical they offer much of a productivity benefit for production code yet. But getting five nines (or whatever) of reliability is crucial for driving in traffic, but not for writing code. One is an online task that has to happen real time, the other you can apply any number of checks you want to before actually using it.
Posted Aug 20, 2025 9:10 UTC (Wed)
by LtWorf (subscriber, #124958)
[Link]
Posted Aug 19, 2025 14:57 UTC (Tue)
by jmalcolm (subscriber, #8876)
[Link] (2 responses)
Driving is a more common skill because driving is much more obviously desirable as a skill. We do not have every young teenager counting the days until they will be allowed to code.
I believe there is a generational shift away from driving. If fewer people get drivers licenses, it will not be because driving got more difficult.
In some ways, coding may be easier for an LLM as it is just language and there are many patterns in code. However, that does not necessarily make LLMs good at design. And even being able to reflect the average is fairly bad in this case.
Posted Aug 19, 2025 16:08 UTC (Tue)
by Wol (subscriber, #4433)
[Link] (1 responses)
Both coding and driving benefit massively from practice, both suffer badly from beginner confidence - the proportion of youngsters who crash cars, and screw up coding, is high for both.
Both suffer badly from most people believing "practice makes perfect", and only a few believing "practicing perfection makes perfect".
The trouble is AI falls extremely firmly into the "practice makes perfect" camp, ignoring the saying "only an idiot expects that repeating the same actions time after time will eventually bring about a different result".
Cheers,
Posted Aug 22, 2025 10:19 UTC (Fri)
by anselm (subscriber, #2796)
[Link]
OTOH, the universe has drastic methods of getting rid of the really bad drivers that don't work on (most) bad programmers in the same way.
As the saying goes, “there are old pilots, and there are bold pilots, but there are no old, bold pilots”. But the world is teeming with old incompetent programmers.
Posted Aug 21, 2025 6:30 UTC (Thu)
by LtWorf (subscriber, #124958)
[Link]
I think this sentence would need a huge [citation necessary] next to it :)
Noise filtering
Noise filtering
Wol
Whence this argument?
Whence this argument?
Whence this argument?
Noise filtering
> humans, certainly. But my mid-range phone from a decade ago is much stronger still than a grandmaster. The point here is
> that human abilities don't correlate to computer abilities. You can't use computer performance in one human task to
> guess the performance the computer will have in other tasks.
Noise filtering
Is this a survey?
Is this a survey?
Is this a survey?
Is this a survey?
Wol
Is this a survey?
Both coding and driving benefit massively from practice, both suffer badly from beginner confidence - the proportion of youngsters who crash cars, and screw up coding, is high for both.
Is this a survey?