I tried this out back in the day and still remember how painful it was listening to the floppy churn for 5 or 10 seconds every time I fired the joystick at a screen element and thinking I could have typed a 2- or 3-letter command and already be looking at my results. Nice POC, but very impractical.