Il progetto SiDOREMI

A system for real-time gesture tracking is presented, used in active well-being self-assessment activities and in particular applied to medical coaching and music-therapy. The system is composed of a gestural interface and a com-puter running own (custom) developed software. During the test sessions a person freely moves his body inside a specifically designed room. The algo-rithms detect and extrapolate features from the human figure, such us spatial position, arms and legs angles, etc. An operator can link these features to sounds synthesized in real time, following a predefined schema. The aug-mented interaction with the environment helps to improve the contact with reality in subjects having autism spectrum disorders (ASD). The system has been tested on a set of young subjects and a team of psychologists has ana-lyzed the results of this experimentation. Moreover, we started to work on graphical feedback in order to realize a multichannel system.