Show HN: ELiTA: Linear-Time Attention Done Right

[acosharma]

https://github.com/LahmacunBear/elita-transformer

A novel Transformer architecture that is much cheaper and faster, while matching and outperforming the standard. Sequence Lengths of 100K+ on 1 GPU. Intuition, evaluation and code available on repository.