Hehe I really am just working it out as I go along - I promise it is fairly pain...

phazonoverload 60 days ago | parent | context | favorite | on: My local model setup on an M4 Pro Mac Mini

Hehe I really am just working it out as I go along - I promise it is fairly painless. Hugging Face allow you to specify your machine and then browse models that fit. And then you can just vibe out 'oh this one is a bit slow let me try another' etc