The economics to run a local model don’t stack up for me but I love the idea of running an open model locally for safety & privacy. I use Claude plus I’ve used Apple’s on device foundational models for parsing recipes and other small tasks in the apps I’ve built.
