On: RLHF is just barely RL

[nyrikki]

LLMs are NLP, what you are talking about is NLU, which has been considered an AI-hard problem for a long time.

I keep looking for discoveries that show any movement there. But LLMs are still basically pattern matching and finding.

They can do impressive things, but they actually have no concept of what the 'right thing' even is, it is statistic not philosophy.