On: AI is slowing down

[pbmonster]

There's an efficiency sweet spot where hardware that people have anyway gets a higher percentage of load.

MacBooks have a lot of memory and a lot of FLOPs. They mostly sit unused all day. Yes, the excess energy use will be higher than a GPU in a datacenter doing the same work, but you have to generate an absurd amount of tokens before the dollar-efficiency catches up with the MacBook.

[gbalduzzi → pbmonster]

You need to have a 3k dollar machine available though, I think you are overestimating how many people have access to it