Effects of Communication Channels and Actor's Gender on Emotion Identification by Native Mandarin Speakers

Yi Lin, Hongwei Ding
<span title="2020-10-25">2020</span> <i title="ISCA"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/trpytsxgozamtbp7emuvz2ypra" style="color: black;">Interspeech 2020</a> </i> &nbsp;
Communication channels and actor's gender have been increasingly reported to influence emotion perception, but past literature exploring these two factors has largely been disassociated. The present study examined how emotions expressed by actors of the two genders are perceived in three different sensory channels (i.e. face, prosody, and semantics). Eighty-eight native Mandarin participants (43 females and 45 males) were asked to identify the emotion displayed visually through face, or
more &raquo; ... ly through prosody or semantics in a fixed-choice format, in which accuracy and reaction time were recorded. Results revealed that visual facial expressions were more accurately and rapidly identified, particularly when posed by female actors. Additionally, emotion perception in the auditory modality was modulated by actor's gender to a greater extent: emotional prosody yielded more accurate and faster responses when expressed by female than male actors, while emotional semantics produced better performances when presented by males. To sum up, paralinguistic (i.e., visual and prosodic) dominance effects are more evident in emotions expressed by female than male actors. In these models, β0 represented the intercept, which was the predicted outcome when all other predictors were equal to 0. β1, β2, and β3 represented the coefficients for actor's gender, communication channel and their interactions respectively. These coefficients reflected how much the outcome variable changed relative to a unit of change in the corresponding predictors. The random intercepts were represented as b0i and b1j, where i varied according to observer (listener) participants and j varied according to test items. An error term (ε) was also included in both models to account for the distance between the predicted value and the actual data point (i.e. residual).
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.21437/interspeech.2020-1498">doi:10.21437/interspeech.2020-1498</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/interspeech/LinD20.html">dblp:conf/interspeech/LinD20</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/fd3l4emv3zgqrordy3d5f5odfu">fatcat:fd3l4emv3zgqrordy3d5f5odfu</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20201213141722/https://www.isca-speech.org/archive/Interspeech_2020/pdfs/1498.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/e0/bb/e0bb0e0003fb541832b338139d14386988725258.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.21437/interspeech.2020-1498"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / doi.org </button> </a>