On: The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A" (2023)

[1718627440]

Because it is "(all)squares are (some)rectangles", so the reverse "(some)rectangles are (all)squares" is also true.

The difference is how you speak about a group term, not the meaning of the word 'to be'.