On: Transformers seem to mimic parts of the brain

[coldtea]

We can reason about all kinds of things that don't exist in the brain...

[edgyquant → coldtea]

For one You can’t actually prove this. We use brains to experience everything so we (humans as a species) can never know.

[coldtea → edgyquant]

What does that even mean?

We can reason about fusion reactors, yet there's no such mechanism in our brains... How's that for a proof?

[robotresearcher → coldtea]

When we're reasoning about them, where are they?

[coldtea → robotresearcher]

Still outside. It's our thoughts about them, models, and concepts that are in the brain.

Plus, even if it was true, this wasn't the parent's point (that things exist in the brain while we're reasoning about them). His point (also wrong) was that different architectures must exist as structures in the brain (not as concepts we think and memories etc., but as parts of brains matter organization and wiring) for us to be able to reason about it.