I’ve found this fantastic video (bonus that the sound track used sounds like Kid Koala), together with the code… but it’s for Windows 🙁
Projects like this sometimes tempt me back to the darkside.
Looking on through the list of projects I found another that I would love to give a try: Keyboard Anywhere
I started out putting the project together, although disappointingly I ran into a wall trying to install PyQGLViewer on 13.10 🙁
Currently trying Ubuntu + Kinect + OpenNI + PrimeSense from MitchTech.net