2026-10-17 20:51 UTC
Replaying the seed will only get you the same result using a particular engine and a particular random number generator
And the seed and rng are all part of the LLM. If you use the same inputs you get the same output. That’s the definition of determinism.
Determinism does not care whether or not the user/programmer understands the program or not. The word you’re probably looking for is “unpredictable” or “less predictable”.
Replies (1)
-
@wewbull@feddit.uk 2026-10-17 22:22
Everybody understands what you’re saying. Yes, the source of randomness in a computer is deterministic (unless you have a physical source of entropy). Every computer program is deterministic. Nothing about the operation of LLMs relys on that determinism or views it as useful. LLMs are probabilistic in nature and require randomness (emulated or real). When people are saying it’s not deterministic they are stating that there are multiple outputs possible for a single input (excluding the seed to the RNG because it’s not necessary to use a deterministic source of randomness). That is fundamentally different to a compiler, which is the overall point being made.