Hacker Newsnew | past | comments | ask | show | jobs | submit | blazinglyfast's commentslogin

> even if it was deterministic (which you can technically make it to be I guess?)

No. LLMs are undefined behavior.


OP means “given the same input, produce the same output” determinism. This isn’t really much different from normal compilers, you might have a language spec, but at the end of the day the results are determined by the concrete compiler’s implementation.

But most LLM services on purpose introduce randomness, so you don’t get the same result for the same input you control as a user.


You can get deterministic output if just turn the temperature all the way down. The problem is that you usually get really bad results, deterministically. It turns out the randomness helps in finding solutions.

You can also get deterministic output if you use whatever temperature you want and use an arbitrary fixed RNG seed.

With the best gaming OST of all time.


Have you tried kitty?



False dichotomy. Both can be true.


> False dichotomy.

Not sure I follow, I didn't say it wasn't worrying or an issue. Just the reasons for it getting to this point are valid.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: