Yes, it's just yoinking the weights out of the embeddings layer.

		minimaxir 4 days ago \| parent \| context \| favorite \| on: Visualizing GPT-OSS-20B embeddings Yes, it's just yoinking the weights out of the embeddings layer.