Abstract
Modern music delivery contexts include the real-time distribution of musical performances as immersive media (‘metaverse concerts’) to online audiences. This paper details an investigatory deployment of a novel server-based spatial audio rendering system for this context, considering distribution to practical wireless Virtual Reality (VR) audience endpoint. Ambisonic auralisation is provided with 6 Degrees of Freedom (6DoF) using a Spatial Impulse Response (SIR) interpolation approach which is efficient for large-scale distribution. Binaural audio is distributed to a mobile device at the audience endpoint using low-latency Network Music Performance (NMP) streaming software. Improvement in spatial audio rendering is achieved relative to that which is possible on consumer HMDs. Latency measurements suggest acceptable motion-sound latency is not achieved for the mobile device, however may be achievable in other distribution contexts, or with optimised systems.
| Original language | English |
|---|---|
| Title of host publication | 2024 IEEE 5th International Symposium on the Internet of Sounds (IS2) |
| Publisher | IEEE |
| Number of pages | 8 |
| ISBN (Electronic) | 979-8-3503-6652-5 |
| ISBN (Print) | 979-8-3503-6653-2 |
| DOIs | |
| Publication status | Published - 7 Oct 2024 |
| Event | 2024 IEEE 5th International Symposium on the Internet of Sounds (IS2) - Erlangen, Germany Duration: 30 Sept 2024 → 2 Oct 2024 |
Conference
| Conference | 2024 IEEE 5th International Symposium on the Internet of Sounds (IS2) |
|---|---|
| Country/Territory | Germany |
| City | Erlangen |
| Period | 30/09/24 → 2/10/24 |