On: The Subprime AI Crisis

[elorant]

Why would non-geeks want to run a local LLM? Electricity prices alone are quite high. Why not pay a subscription on a cloud service and be done with it.

[bryanlarsen → elorant]

My point is that you will have many cloud services to choose from if geeks can build them easily, which will keep prices down.

[xyc → elorant]

Privacy could be one reason. There are a lot of cases where people do not want to send data to a cloud service.