This is very cool and I could have seriously used this when recovering from RSI! However, it's not exactly a great argument that this is better than a keyboard and mouse for those who are abled enough to use them fully.
Well tbf, we’ve had decades of improving mouse and keyboard interfaces, but beyond better speech to text, natural language interfaces have been the same for like 15 years.
The mouse was controversial on release as well, since most computers weren’t graphical at the time.
Let the LLM backed interfaces cook. I don’t think they’re a replacement for graphical UIs, but that doesn’t mean they won’t be better for some applications.
Braille, for example, can be read by blind people AND non-blind people in dark rooms. Not strictly better than regular text, but far from useless.
