Embodied Conversational Agents in eHealth: How Facial and Textual Expressions of Positive and Neutral Emotions Influence Perceptions of Mutual Understanding

Silke ter Stal, Gerbrich Jongbloed, Monique Tabak
<span title="2021-07-17">2021</span> <i title="Oxford University Press (OUP)"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/sta3olfrdjehleaou2d7q26cwy" style="color: black;">Interacting with computers</a> </i> &nbsp;
Embodied conversational agents (ECAs) could engage users in eHealth by building mutual understanding (i.e. rapport) via emotional expressions. We compared an ECA's emotions expressed in text with an ECA's emotions in facial expressions on users' perceptions of rapport. We used a $2 \times 2$ design, combining a happy or neutral facial expression with a happy or neutral textual expression. Sixty-three participants (mean, 48$ \pm $22 years) had a dialogue with an ECA on healthy living and rated
more &raquo; ... ltiple rapport items. Results show that participants' perceived rapport for an ECA with a happy facial expression and neutral textual expression and an ECA with a neutral facial expression and happy textual expression was significantly higher than the neutral value of the rapport scale ($P = 0.049$ and $P = 0.008$, respectively). Furthermore, results show no significant difference in overall rapport between the conditions ($P = 0.062$), but a happy textual expression for an ECA with a neutral facial expression shows higher ratings of the individual rapport items helpfulness ($P = 0.019$) and enjoyableness ($P = 0.028$). Future research should investigate users' rapport towards an ECA with different emotions in long-term interaction and how a user's age and personality and an ECA's animations affect rapport building. Optimizing rapport building between a user and an ECA could contribute to achieving long-term interaction with eHealth.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1093/iwc/iwab019">doi:10.1093/iwc/iwab019</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/27fteuyxvrddncykrkhswccr4q">fatcat:27fteuyxvrddncykrkhswccr4q</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20210720214331/https://watermark.silverchair.com/iwab019.pdf?token=AQECAHi208BE49Ooan9kkhW_Ercy7Dm3ZL_9Cf3qfKAc485ysgAAAtMwggLPBgkqhkiG9w0BBwagggLAMIICvAIBADCCArUGCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMwjeXWJSIA_XM_XqSAgEQgIIChiLgwHEqj3Qddrn_09m80cHCnuYDA0xHBMLOaeLsBCOgWUpuVLpSFJnE79KAJ7VV85sgrlfc8RnfJQCQWEO-7Ds6RpRP1z43B4VxtpiXC1jrYEyvLRT3UKAwRF-Kkmc9FD68ADe5YNC1vJNLsb9xvifNN597l8MtZUSfFsVSJeZrXSuW8TnicE3YjbroY7P59glvlarRwF_6tT4_tZZ_ion-80gA13UaPOR3vIsH7rakIjxHCreuZuTNXd4L_rDHhveH633XaMUu-gbxkcsxXTZHf9sCGeQKMBafcytPIBebPkcYnCtjOiWVRunYh9slgDTc2Mc3ozKcRONl_4EkCxoqBAAJErmCZlERBJ3KT6RfbBFlB3TowGl1XR3wPZ1XttreYqyTYL4KUF_wY0WU-iE8MUsAS4G0HQ9AN_yzVKtC9QfnmfSiD_KOZOrQ7A4bsZCYC34S4oW2CcqSmf6nI_aiCtO6LS_pPNx6G7NaJCwild8e6lDFvXgrvkOGddCmgFib2Asw3FFQ8FuFR4x0G5VV9FPNQ9E-_W8Bjt1ZUZ8R1NmDAtPBs5gJW0kT3gkYQ5NE-5JFWPDVeIcxpv2_5OgqA1HuR2w4ON0S_NvObjP2jrlyzvl8dhJt2bx4nQOjfLiRooQPXxbZSlZkTbbcx8ECg8fKWV1vBXFjpUK8HGx3Cmts6AC42uOO2ShCxuuZp91AuD_6FVZ-zSzTxmZ9rmx5GV_ClAAQjblIBXXdb0rRuS6YSnLPcGAQmp8T5ySdrToI6FGGTGZPhvY994KltJpiUB0GbiGArPUNj-JJFSSYZRAxyBzyaeaV-UIHIfQbifEk_R-gOYmYsBVhvRQE2Afyhf0n7YM" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/35/1a/351a974cfbdcdfbad4363300c3a3d601936f25eb.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1093/iwc/iwab019"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> oup.com </button> </a>