Adaptation to visual actions generate auditory action aftereffects

TY - CONF

T1 - Adaptation to visual actions generate auditory action aftereffects

AU - Page, Stephen

AU - Barraclough, Nick

PY - 2011

Y1 - 2011

N2 - Repeated exposure (adaptation) to visual actions can induce adaptation aftereffects influencing subsequent perception of visual actions (Barraclough, Keith, Xiao, Oram, & Perrett, 2009). Cross-modal aftereffects have been found where adapting to motion in depth causes subsequent auditory amplitude aftereffects (Kitagawa & Ichihara, 2002). We tested whether hand action sound perception was influenced by prior adaptation to different modality stimuli (auditory, visual only, audiovisual, or orthographic representations of actions) in order to investigate if actions were coded multimodally. After adapting to auditory action sounds (hand knocking and hand slapping), subsequent test stimuli (blended ‘knock’ and ‘slap’ sounds) sounded less like the adapting stimulus. This aftereffect showed a characteristic increase with repetition of the adapting stimulus. We also observed aftereffects following audiovisual and visual only adaptation, but not following orthographic stimuli. These crossmodal adaptation aftereffects suggest multimodal coding of actions in humans, and may result from adaptation of multimodal neurons involved in action coding similar to those observed in the Superior Temporal Sulcus of the macaque monkey (Barraclough, Xiao, Oram, & Perrett, 2005).

AB - Repeated exposure (adaptation) to visual actions can induce adaptation aftereffects influencing subsequent perception of visual actions (Barraclough, Keith, Xiao, Oram, & Perrett, 2009). Cross-modal aftereffects have been found where adapting to motion in depth causes subsequent auditory amplitude aftereffects (Kitagawa & Ichihara, 2002). We tested whether hand action sound perception was influenced by prior adaptation to different modality stimuli (auditory, visual only, audiovisual, or orthographic representations of actions) in order to investigate if actions were coded multimodally. After adapting to auditory action sounds (hand knocking and hand slapping), subsequent test stimuli (blended ‘knock’ and ‘slap’ sounds) sounded less like the adapting stimulus. This aftereffect showed a characteristic increase with repetition of the adapting stimulus. We also observed aftereffects following audiovisual and visual only adaptation, but not following orthographic stimuli. These crossmodal adaptation aftereffects suggest multimodal coding of actions in humans, and may result from adaptation of multimodal neurons involved in action coding similar to those observed in the Superior Temporal Sulcus of the macaque monkey (Barraclough, Xiao, Oram, & Perrett, 2005).

M3 - Poster

ER -