3D sound and 3D image interactions: a review of audio-visual depth perception

Jonathan Berry; David  Roberts; Nicolas Steven Holliman

doi:doi:10.1117/12.2047771

3D sound and 3D image interactions: a review of audio-visual depth perception

Jonathan Berry, David Roberts, Nicolas Steven Holliman

Theatre, Film, TV and Interactive Media

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

The design and application of 3D stereoscopic displays and images have been subject to much research over several years. 3D (or spatial) sound systems became widely available comparatively recently, so have not been studied to the same extent. Both 3D displays and sound systems markedly improve depth perception by conveying extra depth cues to the audience. There is currently considerable interest in the integration of 3D video and 3D audio, suggesting it is timely to review depth perception for 3D audio-visual display systems. When the brain combines conflicting auditory and visual cues, some interesting effects can be found in the final percept that may be of interest to display and content designers. We begin with an overview of both visual and auditory depth perception, before focusing upon the cross-modal effects applicable in audio-visual depth perception.

Original language	English
Title of host publication	Human Vision and Electronic Imaging XIX
Editors	Bernice E. Rogowitz, Thrasyvoulos N. Pappas, Huib de Ridder
Place of Publication	San Francisco
Publisher	SPIE
Number of pages	16
Volume	9014
ISBN (Print)	9780819499318
DOIs	https://doi.org/doi:10.1117/12.2047771
Publication status	Published - 25 Feb 2014

Bibliographical note

Invited presentation

Access to Document

doi:10.1117/12.2047771

Cite this

@inproceedings{a2e99f90775747668b2e8b79abe22810,

title = "3D sound and 3D image interactions: a review of audio-visual depth perception",

abstract = "The design and application of 3D stereoscopic displays and images have been subject to much research over several years. 3D (or spatial) sound systems became widely available comparatively recently, so have not been studied to the same extent. Both 3D displays and sound systems markedly improve depth perception by conveying extra depth cues to the audience. There is currently considerable interest in the integration of 3D video and 3D audio, suggesting it is timely to review depth perception for 3D audio-visual display systems. When the brain combines conflicting auditory and visual cues, some interesting effects can be found in the final percept that may be of interest to display and content designers. We begin with an overview of both visual and auditory depth perception, before focusing upon the cross-modal effects applicable in audio-visual depth perception.",

author = "Jonathan Berry and David Roberts and Holliman, {Nicolas Steven}",

note = "Invited presentation",

year = "2014",

month = feb,

day = "25",

doi = "doi:10.1117/12.2047771",

language = "English",

isbn = "9780819499318",

volume = "9014",

editor = "Rogowitz, {Bernice E.} and Pappas, {Thrasyvoulos N.} and {de Ridder}, Huib",

booktitle = "Human Vision and Electronic Imaging XIX",

publisher = "SPIE",

address = "United States",

}

3D sound and 3D image interactions: a review of audio-visual depth perception. / Berry, Jonathan; Roberts, David ; Holliman, Nicolas Steven.
Human Vision and Electronic Imaging XIX. ed. / Bernice E. Rogowitz; Thrasyvoulos N. Pappas; Huib de Ridder. Vol. 9014 San Francisco: SPIE, 2014.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - 3D sound and 3D image interactions

T2 - a review of audio-visual depth perception

AU - Berry, Jonathan

AU - Roberts, David

AU - Holliman, Nicolas Steven

N1 - Invited presentation

PY - 2014/2/25

Y1 - 2014/2/25

N2 - The design and application of 3D stereoscopic displays and images have been subject to much research over several years. 3D (or spatial) sound systems became widely available comparatively recently, so have not been studied to the same extent. Both 3D displays and sound systems markedly improve depth perception by conveying extra depth cues to the audience. There is currently considerable interest in the integration of 3D video and 3D audio, suggesting it is timely to review depth perception for 3D audio-visual display systems. When the brain combines conflicting auditory and visual cues, some interesting effects can be found in the final percept that may be of interest to display and content designers. We begin with an overview of both visual and auditory depth perception, before focusing upon the cross-modal effects applicable in audio-visual depth perception.

AB - The design and application of 3D stereoscopic displays and images have been subject to much research over several years. 3D (or spatial) sound systems became widely available comparatively recently, so have not been studied to the same extent. Both 3D displays and sound systems markedly improve depth perception by conveying extra depth cues to the audience. There is currently considerable interest in the integration of 3D video and 3D audio, suggesting it is timely to review depth perception for 3D audio-visual display systems. When the brain combines conflicting auditory and visual cues, some interesting effects can be found in the final percept that may be of interest to display and content designers. We begin with an overview of both visual and auditory depth perception, before focusing upon the cross-modal effects applicable in audio-visual depth perception.

U2 - doi:10.1117/12.2047771

DO - doi:10.1117/12.2047771

M3 - Conference contribution

SN - 9780819499318

VL - 9014

BT - Human Vision and Electronic Imaging XIX

A2 - Rogowitz, Bernice E.

A2 - Pappas, Thrasyvoulos N.

A2 - de Ridder, Huib

PB - SPIE

CY - San Francisco

ER -