On: Why I'm still bearish on LLMs after Navier-Stokes

[bravoetch]

I was a young child when I learned chess by reading a short book, then practicing with a friend. That is not how LLMs learn. I'm no expert on LLMs, but if you showed a human all chess games and books in all history and then said 'play chess' and they still kept making illegal moves, they would have to have a brain injury.

[harimau777 → bravoetch]

It seems like an LLM potentially could learn that way if each practice game it participated in was added to its training data.

[willmarch → harimau777]

Yes, this is essentially how AlphaGo and AlphaZero algorithms work to train superhuman Go/chess/shogi agents. It’s an elegant algorithm that is analogous to how humans learn games.