On: Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet

[kromem]

Their manipulation of the vectors and the effects produced would suggest that it isn't that the SAE is just finding phantom representations that aren't really there.