On: ChunkLLM: A Lightweight Pluggable Framework for Accelerating LLMs Inference

[ProofHouse]

wasn't this the attention sink concept to some degree? I mean it doesn't seem out of the realm of possibility that if the latency overhead isn't signifigant, that frontier models start adopting similar to DeepSeek OCR tech