On: Running a 180B parameter LLM on a single Apple M2 Ultra

[bugglebeetle]

And if all open source extends their models, they can accrue those benefits back to themselves. This is already how they’ve become such a huge player in machine learning (open sourcing amazing stuff).