On: Show HN: Semantic Calculator (king-man+woman=?)

[sdeframond]

Such results are inherently limited because a same word can have different meanings depending on context.

The role of the Attention Layer in LLMs is to give each token a better embedding by accounting for context.