On: Where does next-token prediction leave us?

[overgard]

You should read a book on how LLMs actually work on a technical level. Saying they just need to get "5x better" and suddenly they're performing miracles is just nonsense hyperbole

[dyauspitr → overgard]

I’m very aware of how they work and pretty much everything they do is emergent.