Hah, really appreciate your encouragement. The previous post where I shared the GH repo got an enormous acknowledgement so maybe it just averaged out? :)
It would be really cool, and I think we're not very far away from this being something you have on your phone.
The pilot name comes from Microsoft's use of "Copilot" for their AI assistant products, and I tried to play on it with macOSpilot which is maco(s)pilot. I think that naming has completely flown over everyone's heads :D
I've not tried this on Windows, but might actually work if you run the packager. Try it. If it doesn't work, there shouldn't be too much that is macOS specific -- so you should be able to tweak the underlying code to work with Windows with fairly few changes.
Yes. I think you commented this somewhere else, and I like it. I was considering doing something similar to have it execute keyboard commands, but decided it would have to wait for a future version. I think click + type + and performing other actions would be powerful, especially if it can do it fast and accurate. Then it's less about "How do I do X?", and more "Can you do X for me?".
If you're ok with it, you can use the mobile app -- it supports voice. Then you just have the same chat/thread open on your computer in case you need to copy/paste something.
Good idea, yes I do use the iOS app with voice all the time. But didn’t occur to me to use the iOS app to start a chat and continue on desktop. The main pain though is where I have lengthy back and forth with GPT4 discussing an approach or getting some piece of code just right. It often gets tiring enough that I just quickly type with lots of typos and it still does fine. But I’d rather not have to do that because these typo-filled chats will be hard to search though later :)
Did you change the GPT Vision system prompt at all? I wonder if changing it to state getting help with specifically Ableton, and maybe some guidelines around what kind of help you want could make it better?