On: Local LLM inference – impressive but too hard to work with

[anarticle]

Seems fine to me, I use it like a local google for software eng questions, or rig it into aider to write tests while I'm doing something else. Keeps me focused and out of my web browser frankly.

EDIT: oh! It's also fantastic if you're on a plane!