Found this Kickstarter project that’s now a company.
I'm not at all interested in this as a keyboard per se, but the fact that it functions as a piano keyboard as well gives me ideas. I wonder if the latency and resolution would allow for things like automatic transcription of written documents as you write, a mouse replacement, or other cool things that I haven't thought of yet :)
They claim they have an SDK. I'll have to explore this some more when I have time later this evening.
1. Point a camera at a surface (be it a piece of paper or whatever).
2. Write/print a word on that paper and use CV/OCR to parse it.
3. Detect when a person has pressed on that word and exec the command specified by the text.
Instant macro pad?