I love the idea to be able to work in many places while keeping a good posture!
On the pictures, it looks like there is no pointing device. Is the pointing done by eye tracking? How do you click on things? How do you deal with "focus follow mouse"? For example I often look at one window while typing in another.
Yes, Simula allows for you to retain full control of window management with only a keyboard; mouse and hand gestures are not necessarily needed, though will be supported also.
In order to do this, we make use forward eye gaze, which you can use to move mouse cursors (and also to move windows around). Customizable keyboard shortcuts can be configured to resize/shrink/expand/zoom in/zoom out/push in/push away windows. Default keyboard shortcuts are explained in our GitHub repo (https://github.com/SimulaVR/Simula).
RE "focus follow mouse", Simula is currently set so that the "actively gazed at window" is the one that receives all inputs. We have found this to be pretty resilient almost all use cases, but as you said there are scenarios where you want to lock focus on a window while typing on another. We should add a keyboard shortcut to do this (would be very easy to implement).
Thanks for your interest BTW. The posture/freedom of movement part is one of my favorite things about VR computing. I love to work on things while "supine".[1] It allows you to get way more time spent on a task without the constraint of physical/postural fatigue limiting you.
I don't know how it works with their headset but with the Quest 2 hand tracking (which is handled via four cheap IR cameras) you just make a pinch motion with your fingers to "click" or click-and-drag: https://support.oculus.com/articles/headsets-and-accessories...
I assume that doing a right-click would be a pinch-and-hold sort of situation or maybe you could just use the left hand for that sort of thing.
On the pictures, it looks like there is no pointing device. Is the pointing done by eye tracking? How do you click on things? How do you deal with "focus follow mouse"? For example I often look at one window while typing in another.