I’m curious what interesting use cases people on here have thought of for locally hosted llms. I’m also curious what form factor will need to be supported to make you use case.
I think because of the large amount of ram that’s needed, something phone sized could not be that useful.
But I could be wrong, maybe there is a use case for a really dumb small model that can be used to great effect.
Thoughts?!
Aside from that, it would be cool to have some kind of automatic inventory and info system for items in my home that can make minor assumptions about what you want, or do a "twenty questions" game to help find a word you forgot. My gf is dyslexic and can't remember words that she's only seen in writing, so she sometimes gets really irritated when she's trying to explain stuff and she can't even think of what letter the word starts with. I notice that when she wants to think of a specific word like "conglomeration" she has a very hard time thinking of how to describe the concept. So something that would be like "are you thinking of a noun? Is it a person, group, etc?" without her having to write a stating sentence would be helpful. It would have to just have a "start questions" button, bc she will get stressed by trying to think of how to start the writing lol