On: Nvidia's Project Digits is a 'personal AI supercomputer'

[JohnBooty]

They have, because until now Apple Silicon was the only practical way for many to work with larger models at home because they can be configured with 64-192GB of unified memory. Even the laptops can be configured with up to 128GB of unified memory.

Performance is not amazing (roughly 4060 level, I think?) but in many ways it was the only game in town unless you were willing and able to build a multi-3090/4090 rig.

[moralestapia → JohnBooty]

I would bet that people running LLMs on their Macs, today, is <0.1% of their user base.

[sroussey → moralestapia]

People buying Macs for LLMs—sure I agree.

Since the current MacOS comes built in with small LLMs, that number might be closer to 50% not 0.1%.

[moralestapia → sroussey]

I'm not arguing whether or not Macs are capable of doing it, but whether is a material force that drives people to buy Macs because of it; it's not.

[justincormack → moralestapia]

Higher than that buying the top end machines though, which are very high margin

[throwaway48476 → moralestapia]

All macs? Yes. But of 192GB mac configs? Probably >50%