Project

Digito: A Fine-Grained, Gesturally Controlled Virtual Musical Instrument

Groups

Digito is a gesturally controlled virtual musical instrument, controlled through a number of intricate hand gestures which provide both discrete and continuous control of its sound engine. The hand gestures are captured using a 3D depth sensor and recognized using computer vision and machine learning algorithms. Digito is currently being used to evaluate the possible strengths and limitations of gesturally controlled virtual musical instruments and to assist in uncovering new questions regarding the design of gestural musical interfaces.