Here's my big question on the interfaces people are making for the leap motion:
Everyone seems to be trying to replicate iPad gestures in 3D, e.g., point your finger at something, drag something around by pointing.
How about instead we create a virtual hand that shows up in your screen and it mirrors the movements of your real hand and you use that to interact with objects on the screen?
I just think it would be awesome to be able to virtually reach into your screen and move things around! And it seems like it would be quite intuitive, no?
As some examples: I'm picturing moving your hand to the top of a window, make a grabbing motion and grab the top of a window and move it around. Grab the corner of a window to resize. You could even have the hand type on a virtual keyboard shown inside the screen. What do you guys think?
It feels like you're taking a 3D interaction and smashing it back down into 2D. While neat, it's unlikely to catch on.
What would be amazing is using this to interact with a 3D display system. Not the 3D in a box that you get with TV's, but something closer to what we often think of holograms.
Holograms are probably a ways off (though they are doing interesting things with targeting light at retinas).
The Occulus Rift though (as others have mentioned) may be able to do something truly awesome when paired with an interface like this.
Both devices are incredibly exciting. If they manage to mesh up...
Good point. I think this would complement the Occulous rift perfectly. You could actually use your hands to interact with the enviroment with centimeter precision! Let's hope someone thinks of this.
Everyone seems to be trying to replicate iPad gestures in 3D, e.g., point your finger at something, drag something around by pointing.
How about instead we create a virtual hand that shows up in your screen and it mirrors the movements of your real hand and you use that to interact with objects on the screen?
I just think it would be awesome to be able to virtually reach into your screen and move things around! And it seems like it would be quite intuitive, no?
As some examples: I'm picturing moving your hand to the top of a window, make a grabbing motion and grab the top of a window and move it around. Grab the corner of a window to resize. You could even have the hand type on a virtual keyboard shown inside the screen. What do you guys think?