Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

There are two use cases where this is useful:

1. privacy (w.r.t. personal data, human agency, IP, whatever) – this absolutely is the most crucial.

2. if the needs are absolutely sufficed with local model(s) runnable on a super-expensive mac with a whole lot of RAM (not less than triple digit GBs usually) and the equivalent cost on API/subscription would be at least few times (say >=2-3x?) factoring in mac repair/maintainence/etc (yep, that does happen)

There's a 3rd case thoguh – the hobbylist case, which, imho and in my anecdotal evidence, is the majority of local-model-chasing outside of enterprise (which is usually not hobbyist to begin with).

So there of couse are three legit use-cases.

PS. Having said that, at this point, any machine you can't control 100% or very close to 100% cannot be said to be 100% or close to 100% private. So without getting into debates of whether Apple is the bastion of privacy or not (esp. they way they have been going about and their software competence, or lack thereof, leave a lot to be desired), or whether we would rather slide down to whataboutism, you can think about that yourself. I had to add this because these days running local models has become synonymous with "if not mac then what" and it might as well have merit, or not.)

 help



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: