When there's no global mutable state you only need generally need a smaller context to figure out what's going on. I imagine it's the same for LLMs.
When there's no global mutable state you only need generally need a smaller context to figure out what's going on. I imagine it's the same for LLMs.