Brain-Body Digital Musical Instrument

Abstract

This talk presents the project, Brain/Body Digital Musical Instrument (BBDMI), a French ANR funded initiative for a digital musical instrument system that uses physiological signals from the human body: from the brain and muscles. It puts in place forms of multi-modal interaction through the hybridization of brain signals (electroencephalography: EEG) and muscle signals (electromyography: EMG). The physiological signals are sonified and mapped to sound synthesis and musical output, including through interactive machine learning. The system is validated in a range of musical settings from concerts to the conservatoire, with a diverse range of users including autistic musicians. The consortium represents the spectrum of research: from hardware development to user-centered design, and the integration of neuroscience and musical performance.

Profile: Professor Atau Tanaka

Atau Tanaka studied Physical Sciences at Harvard University then gained his doctorate in Computer Music at Stanford University’s CCRMA. He has since helped to establish the field of Music Human-Computer Interaction (HCI). Atau has carried out research at IRCAM Centre Pompidou, Apple France, and Sony Computer Science Laboratory (CSL) Paris in areas of interactive music, immersive media, network performance, and human-data interaction. He has performed widely in the experimental music scene with artists like Zbigniew Karkowski, Lillevan, and Cécile Babiole. His work as been exhibited at Ars Electronica, SFMOMA and performed at Sonar and WOMAD festivals amongst others. His research as been supported by the European Research Council, UK and French research councils. He was artistic co-director of STEIM and currently is professor at Goldsmiths University of London, and works with Bristol Interaction Group and MSH Paris Nord.