Augmented Reality to Improve Orchestra Conductors' Headphone Monitoring

Dimitri Soudoplatoff, Amandine Pras

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Conductors face challenges when conducting the orchestra with headphones to synchronize with a soundtrack or a click track. We sent a survey to 12 international conductors to identify and classify those challenges. They primarily reported on balance issues, aggressive click tracks, and the difficulty of hearing the acoustic sound of the orchestra, leading 70% of them to remove one ear out of the headphones. A solution using augmented reality monitoring through binaural rendering and head tracking was tested in various situations and showed that it could successfully reproduce the acoustic sound of the orchestra into the headphones. Another perceptual experiment evaluated the potential of realism of this solution when merging two binaural auditory scenes recorded in the same acoustic space together. Results encourage us to further develop immersive monitoring systems for conductors, with the soundtrack integrated in the real acoustic space.
Original languageEnglish
Title of host publicationAES Convention 142
PublisherAudio Engineering Society
Publication statusPublished - 11 May 2017

Cite this