On: Language models and linguistic theories beyond words

[jonahrd]

This is super interesting. Are there more examples I can see? The one in the article is a famous song which makes me wonder if it's really "decompressing" the data, or just being hunted towards a very common popular pattern of tokens.

[og_kalu → jonahrd]

https://aps.arxiv.org/abs/2309.10668