Gestural Sound Design Toolkit

The Gestural Sound Toolkit is a collection of Max/MSP patches and objects for easy and fast gesture-to-sound scenario prototyping. It includes receivers from motion capture systems, signal processing modules, machine learning modules, and sound synthesis modules.

The function of the toolkit is to give participants a sketching tool to develop prototypes using interactive gestural-sound mappings. It integrates complex techniques for sound synthesis with machine learning of movement, making these techniques available to participants with no background in interactive systems, sound design, and more generally in programming and physical computing. It comprises modules for receiving movement data from sensors, analysing data through machine learning and gesture recognition, and mapping participants’ gestures to sound synthesis.