On: Let's Think Dot by Dot: Hidden Computation in Transformer Language Models

[edmara]

In the case of 3sum, because the LLM has been fine tuned to use 'blank' token key values as a register to represent the sums of specific integer triplets.