On: OpenAI – transformer debugger release

[zamfi]

> it's basically equivalent to trying to understand a human brain's internal world model by analysing its neurons and how they fire

A major challenge here is that it's very hard/expensive to analyze these neurons, especially at any kind of scale within one human.

Not so with LLMs.