Abstract
An influential neural model of face perception suggests that the posterior superior temporal sulcus (STS) is sensitive to those aspects of faces that produce transient visual changes, including facial expression. Other researchers note that recognition of expression involves multiple sensory modalities and suggest that the STS also may respond to crossmodal facial signals that change transiently. Indeed, many studies of audiovisual (AV) speech perception show STS involvement in AV speech integration. Here we examine whether these findings extend to AV emotion. We used magnetoencephalography to measure the neural responses of participants as they viewed and heard emotionally congruent fear and minimally congruent neutral face and voice stimuli. We demonstrate significant supra-additive responses (i.e., where AV > [unimodal auditory + unimodal visual]) in the posterior STS within the first 250 ms for emotionally congruent AV stimuli. These findings show a role for the STS in processing crossmodal emotive signals.
| Original language | English |
|---|---|
| Pages (from-to) | 20010-20015 |
| Number of pages | 6 |
| Journal | Proceedings of the National Academy of Sciences of the United States of America |
| Volume | 106 |
| Issue number | 47 |
| DOIs | |
| Publication status | Published - 23 Nov 2009 |
Keywords
- audio-visual emotion
- emotional faces
- emotional voices
- fear
- gamma
- AUDIOVISUAL INTEGRATION
- CROSSMODAL BINDING
- HUMAN BRAIN
- PERCEPTION
- FACE
- RECOGNITION
- EXPRESSIONS
- CORTEX
- VOICE
- SIGNALS