Sure, my comment about softmax was simply about the probability distribution. Bu...

qeternity 3 months ago | parent | context | favorite | on: σ-GPTs: A new approach to autoregressive models

Sure, my comment about softmax was simply about the probability distribution. But temperature is still part of sampling. If you’re greedy decoding, temperature doesn’t matter.