Adaptation to visual actions generate auditory action aftereffects

Stephen Page, Nick Barraclough

Research output: Contribution to conferencePosterpeer-review


Repeated exposure (adaptation) to visual actions can induce adaptation aftereffects influencing subsequent perception of visual actions (Barraclough, Keith, Xiao, Oram, & Perrett, 2009). Cross-modal aftereffects have been found where adapting to motion in depth causes subsequent auditory amplitude aftereffects (Kitagawa & Ichihara, 2002). We tested whether hand action sound perception was influenced by prior adaptation to different modality stimuli (auditory, visual only, audiovisual, or orthographic representations of actions) in order to investigate if actions were coded multimodally. After adapting to auditory action sounds (hand knocking and hand slapping), subsequent test stimuli (blended ‘knock’ and ‘slap’ sounds) sounded less like the adapting stimulus. This aftereffect showed a characteristic increase with repetition of the adapting stimulus. We also observed aftereffects following audiovisual and visual only adaptation, but not following orthographic stimuli. These crossmodal adaptation aftereffects suggest multimodal coding of actions in humans, and may result from adaptation of multimodal neurons involved in action coding similar to those observed in the Superior Temporal Sulcus of the macaque monkey (Barraclough, Xiao, Oram, & Perrett, 2005).
Original languageEnglish
Publication statusUnpublished - 2011

Cite this