On: The Geometry of Truth: Do LLM's Know True and Fals...

[sam_goody]

"Cows are mammals" means: Array($mammals).includes($cows).

It does not mean $cows === $mammals.

"A is a B" Or "A's are B's" means that A is included in B.

$a === $b ("A is B") implies that $b === $a (B is A), in all cases that I know of.

[ToValueFunfetti → sam_goody]

What cases are there for $a === $b? I guess there's synonyms and rephrasing, but in general it's not a useful relationship in language

[xcv123 → ToValueFunfetti]

From this paper:

https://owainevans.github.io/reversal_curse.pdf

"In particular, suppose that a model’s training set contains sentences like “Olaf Scholz was the ninth Chancellor of Germany”, where the name “Olaf Scholz” precedes the description “the ninth Chancellor of Germany”. Then the model may learn to answer correctly to “Who was Olaf Scholz? [A: The ninth Chancellor of Germany]”. But it will fail to answer “Who was the ninth Chancellor of Germany?” and any other prompts where the description precedes the name."

[wizzwizz4 → ToValueFunfetti]

Batman is Bruce Wayne.

[akomtu → sam_goody]

The operator are, which happens to look similar to an english word, has a meaning that depends on context. Another example is 5/2 means a simple fraction in one context, or a class of polytopes in another.