On: M2 Ultra can run 128 streams of Llama 2 7B in para...

[londons_explore]

You need one good motivated sysadmin.

But if you can motivate that same sysadmin to spend his skills on something more directly benefiting your company, then you should still buy it in.

[hamandcheese → londons_explore]

I think you need one motivated developer who likes to tinker with hardware for a few hours a month.

Given how popular homelabs are, I don't think this would be too hard to find.

[lghh → hamandcheese]

I don’t want to build a business around a dev who likes to “tinker with hardware”.

[hamandcheese → lghh]

Why the scare quotes? It's a skill like any other. Startups are built by folks who wear many hats.

[c0pium → londons_explore]

Now your business depends on that one person, congratulations. Hope they don’t realize that their skills are better suited to working at AWS/Azure etc. for 2x the money. Which they are.

[londons_explore → c0pium]

It's not core stuff. If the one sysadmin leaves, you buy in a solution.

[c0pium → londons_explore]

I mean, fair enough I guess. Why play the OpEx vs CapEx game when you can just pay both.