On: Do AI companies work?

[ninetyninenine]

Likely we are because the actualized end result already exists: the human brain.

The fact that human intelligence exists means that the idea of human level intelligence is not a pipe dream.

The question is whether or not the basic underlying technology of the LLM can achieve that level of intelligence.

[thfuran → ninetyninenine]

And brains do it on about 20 watts.

[asterix_pano → thfuran]

Training takes many years though.

[namaria → asterix_pano]

Training took hundreds of thousands of years. Everyone just gets a foundation model to fine tune for another couple of decades before it can start flipping burgers.

[thfuran → namaria]

It's been something like half a billion years since the first brain.

[namaria → thfuran]

That was a much smaller model, couldn't do much more than crawl around and run away.

[thfuran → namaria]

It was still used as part of pretraining the current model.

[namaria → thfuran]

Nonsense, the current model is a new architectural approach.

It was all explained in that recent paper, "Attention is all your meat"