In the context of Contatto project, the Signal and Images Lab of ISTI-CNR developed a system for active musicotherapy to be used with young subjects affected by autism spectrum disorders (ASD). The system uses a video camera, a FireWire digitalization board, and a Macintosh computer running an original software. During the therapy sessions the patient freely moves his body inside an empty room. The software, using special algorithms, can extrapolate features from the human figure, such us spatial position, arms and legs angles etc. Using the software GUI the medical operator can link these features to sounds synthesized in real time, following the therapy schema. The system latency is very low thanks to the use of Mac OS X native libraries (CoreImage, CoreAudio). The resulting augmented interaction with the environment could help to improve the contact with reality in young autistic subjects. With some little variations, and the use of additional sensors, the system can be successfully used for other diseases, such us Alzheimer.

CONTATTO

Magrini M;Tarabella L;Salvetti O
2010

Abstract

In the context of Contatto project, the Signal and Images Lab of ISTI-CNR developed a system for active musicotherapy to be used with young subjects affected by autism spectrum disorders (ASD). The system uses a video camera, a FireWire digitalization board, and a Macintosh computer running an original software. During the therapy sessions the patient freely moves his body inside an empty room. The software, using special algorithms, can extrapolate features from the human figure, such us spatial position, arms and legs angles etc. Using the software GUI the medical operator can link these features to sounds synthesized in real time, following the therapy schema. The system latency is very low thanks to the use of Mac OS X native libraries (CoreImage, CoreAudio). The resulting augmented interaction with the environment could help to improve the contact with reality in young autistic subjects. With some little variations, and the use of additional sensors, the system can be successfully used for other diseases, such us Alzheimer.
2010
Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI
Immersive systems
Real time sound synthesis
Autism Spectrum Disorders
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/196483
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact