On: Gemma3 – The current strongest model that fits on a single GPU

[michaelbuckbee]

What's the driving reason for local models? Cost? Censorship?

[laborcontract → michaelbuckbee]

PII is the driving force for me. I like to have local models manage my browser tabs, reply to emails, and go through personal documents. I don't trust LLM providers not to retain my data.

[dannyw → michaelbuckbee]

Privacy is another big reason. I like to store my files locally with a backup, not on Dropbox or whatever.