Augmented reality for DAW-based spatial audio creation using smartphones

Adrià M. Cassorla; Gavin Kearney; Andy Hunt; Hashim Riaz; Mirek Stiles; Damian T. Murphy

Augmented reality for DAW-based spatial audio creation using smartphones

Adrià M. Cassorla^*, Gavin Kearney, Andy Hunt, Hashim Riaz, Mirek Stiles, Damian T. Murphy

^*Corresponding author for this work

Research output: Contribution to conference › Paper › peer-review

Abstract

Most tools used to create and manipulate 3D sound are based on a 2D screen GUI. Besides, they are usually controlled using consumer peripherals such as mouse and keyboard. The main concept of this paper is to develop and analyse AR capabilities on smartphones to augment spatial audio production in a DAW. This paper describes the development of an iPhone app that sends OSC control signals to a DAW for real-time spatial panning of sound sources. The research is based on finding different methods to control 3D audio, exploring Apple's ARKit. Results of user tests show that the use of AR to control spatial audio is a feasible option to consider in further research in the audio production industry.

Original language	English
Publication status	Published - 28 May 2020
Event	148th Audio Engineering Society International Convention 2020 - Vienna, Virtual, Online, Austria Duration: 2 Jun 2020 → 5 Jun 2020

Conference

Conference	148th Audio Engineering Society International Convention 2020
Country/Territory	Austria
City	Vienna, Virtual, Online
Period	2/06/20 → 5/06/20

Bibliographical note

Publisher Copyright:
© 2020 148th Audio Engineering Society International Convention. All rights reserved.

Cite this

@conference{312c99910d45487cac6f8b5e582ca48e,

title = "Augmented reality for DAW-based spatial audio creation using smartphones",

abstract = "Most tools used to create and manipulate 3D sound are based on a 2D screen GUI. Besides, they are usually controlled using consumer peripherals such as mouse and keyboard. The main concept of this paper is to develop and analyse AR capabilities on smartphones to augment spatial audio production in a DAW. This paper describes the development of an iPhone app that sends OSC control signals to a DAW for real-time spatial panning of sound sources. The research is based on finding different methods to control 3D audio, exploring Apple's ARKit. Results of user tests show that the use of AR to control spatial audio is a feasible option to consider in further research in the audio production industry.",

author = "Cassorla, {Adri{\`a} M.} and Gavin Kearney and Andy Hunt and Hashim Riaz and Mirek Stiles and Murphy, {Damian T.}",

note = "Publisher Copyright: {\textcopyright} 2020 148th Audio Engineering Society International Convention. All rights reserved.; 148th Audio Engineering Society International Convention 2020 ; Conference date: 02-06-2020 Through 05-06-2020",

year = "2020",

month = may,

day = "28",

language = "English",

}

TY - CONF

T1 - Augmented reality for DAW-based spatial audio creation using smartphones

AU - Cassorla, Adrià M.

AU - Kearney, Gavin

AU - Hunt, Andy

AU - Riaz, Hashim

AU - Stiles, Mirek

AU - Murphy, Damian T.

PY - 2020/5/28

Y1 - 2020/5/28

N2 - Most tools used to create and manipulate 3D sound are based on a 2D screen GUI. Besides, they are usually controlled using consumer peripherals such as mouse and keyboard. The main concept of this paper is to develop and analyse AR capabilities on smartphones to augment spatial audio production in a DAW. This paper describes the development of an iPhone app that sends OSC control signals to a DAW for real-time spatial panning of sound sources. The research is based on finding different methods to control 3D audio, exploring Apple's ARKit. Results of user tests show that the use of AR to control spatial audio is a feasible option to consider in further research in the audio production industry.

AB - Most tools used to create and manipulate 3D sound are based on a 2D screen GUI. Besides, they are usually controlled using consumer peripherals such as mouse and keyboard. The main concept of this paper is to develop and analyse AR capabilities on smartphones to augment spatial audio production in a DAW. This paper describes the development of an iPhone app that sends OSC control signals to a DAW for real-time spatial panning of sound sources. The research is based on finding different methods to control 3D audio, exploring Apple's ARKit. Results of user tests show that the use of AR to control spatial audio is a feasible option to consider in further research in the audio production industry.

UR - http://www.scopus.com/inward/record.url?scp=85091571876&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85091571876

T2 - 148th Audio Engineering Society International Convention 2020

Y2 - 2 June 2020 through 5 June 2020

ER -

Augmented reality for DAW-based spatial audio creation using smartphones

Abstract

Conference

Bibliographical note

Other files and links

Cite this