Preferred form of modification
Preferred form of modification
Posted Mar 10, 2026 17:34 UTC (Tue) by phm (subscriber, #168918)In reply to: Preferred form of modification by koverstreet
Parent article: Debian decides not to decide on AI-generated contributions
No, it won't. You can run an LLM that way - temperature = 0 - but you generally don't want to. Like in many other algorithms, introducing some stochastic noise often produces better results.Given the same settings (temperature, model, RNG seed) an LLM will produce the same results. Here are some example sessions run with llama.cpp (LLM is mdradermacher's quantization i1 of Apertus 8B, abliterated) on a Thinkpad.
t420:~/llama.cpp/build/bin$ ./llama-cli --temp 20 --seed 12345 $LLM
> Hello!
Hello! It's great to connect with you. If you have a question or a [^C]
# Running the same command again:
t420:~/llama.cpp/build/bin$ ./llama-cli --temp 20 --seed 12345 -m $LLM
> Hello!
Hello! It's great to connect with you [^C]
./llama-cli --temp 20000000 --seed 12345 -m $LLM
> Hello!
Hello! Welcome to the SwissAI assistant service. What can I help [^C]