On: Training LLMs to Reason in a Continuous Latent Space

[rsrsrs86]

Please spread the word that predicting the next one is not intelligence. It’s markov…

[esafak → rsrsrs86]

It depends on how you predict. To predict better and better you need intelligence.

[threeseed → esafak]

Knowledge is distinct from intelligence.

You can predict better and better with simply more knowledge i.e. data.

[esafak → threeseed]

That only gets you as far as the frontier of knowledge. To go beyond you need intelligence.