Coherent emotional perception from body expressions and the voice

Yeh, Pei-Wen and Geangu, Elena and Reid, Vincent Michael (2016) Coherent emotional perception from body expressions and the voice. Neuropsychologia, 91. pp. 99-108. ISSN 0028-3932

[thumbnail of 1-s2.0-S0028393216302822-main]
PDF (1-s2.0-S0028393216302822-main)
1_s2.0_S0028393216302822_main.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial-NoDerivs.

Download (1MB)


Perceiving emotion from multiple modalities enhances the perceptual sensitivity of an individual. This allows more accurate judgments of others’ emotional states, which is crucial to appropriate social interactions. It is known that body expressions effectively convey emotional messages, although fewer studies have examined how this information is combined with the auditory cues. The present study used event-related potentials (ERP) to investigate the interaction between emotional body expressions and vocalizations. We also examined emotional congruency between auditory and visual information to determine how preceding visual context influences later auditory processing. Consistent with prior findings, a reduced N1 amplitude was observed in the audiovisual condition compared to an auditory-only condition. While this component was not sensitive to the modality congruency, the P2 was sensitive to the emotionally incompatible audiovisual pairs. Further, the direction of these congruency effects was different in terms of facilitation or suppression based on the preceding contexts. Overall, the results indicate a functionally dissociated mechanism underlying two stages of emotional processing whereby N1 is involved in cross-modal processing, whereas P2 is related to assessing a unifying perceptual content. These data also indicate that emotion integration can be affected by the specific emotion that is presented.

Item Type:
Journal Article
Journal or Publication Title:
Additional Information:
This is the author’s version of a work that was accepted for publication in Neuropsychologia. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Neuropsychologia, 91, 2016 DOI: 10.1016/j.neuropsychologia.2016.07.038
Uncontrolled Keywords:
?? erpaudiovisual processingbody expressionsemotioncongruencycross-modal predictioncognitive neurosciencebehavioral neuroscienceexperimental and cognitive psychology ??
ID Code:
Deposited By:
Deposited On:
16 Aug 2016 10:20
Last Modified:
07 May 2024 23:55