Is there code somewhere? I don't totally understand the double position and shuf...

aconz2 8 months ago | parent | context | favorite | on: σ-GPTs: A new approach to autoregressive models

Is there code somewhere? I don't totally understand the double position and shuffling. Interesting they use concat instead of plus for the positionals