1. privacy (w.r.t. personal data, human agency, IP, whatever) – this absolutely is the most crucial.
2. if the needs are absolutely sufficed with local model(s) runnable on a super-expensive mac with a whole lot of RAM (not less than triple digit GBs usually) and the equivalent cost on API/subscription would be at least few times (say >=2-3x?) factoring in mac repair/maintainence/etc (yep, that does happen)
There's a 3rd case thoguh – the hobbylist case, which, imho and in my anecdotal evidence, is the majority of local-model-chasing outside of enterprise (which is usually not hobbyist to begin with).
So there of couse are three legit use-cases.
PS. Having said that, at this point, any machine you can't control 100% or very close to 100% cannot be said to be 100% or close to 100% private. So without getting into debates of whether Apple is the bastion of privacy or not (esp. they way they have been going about and their software competence, or lack thereof, leave a lot to be desired), or whether we would rather slide down to whataboutism, you can think about that yourself. I had to add this because these days running local models has become synonymous with "if not mac then what" and it might as well have merit, or not.)
1. privacy (w.r.t. personal data, human agency, IP, whatever) – this absolutely is the most crucial.
2. if the needs are absolutely sufficed with local model(s) runnable on a super-expensive mac with a whole lot of RAM (not less than triple digit GBs usually) and the equivalent cost on API/subscription would be at least few times (say >=2-3x?) factoring in mac repair/maintainence/etc (yep, that does happen)
There's a 3rd case thoguh – the hobbylist case, which, imho and in my anecdotal evidence, is the majority of local-model-chasing outside of enterprise (which is usually not hobbyist to begin with).
So there of couse are three legit use-cases.
PS. Having said that, at this point, any machine you can't control 100% or very close to 100% cannot be said to be 100% or close to 100% private. So without getting into debates of whether Apple is the bastion of privacy or not (esp. they way they have been going about and their software competence, or lack thereof, leave a lot to be desired), or whether we would rather slide down to whataboutism, you can think about that yourself. I had to add this because these days running local models has become synonymous with "if not mac then what" and it might as well have merit, or not.)