TY - GEN
T1 - Getting Emotional Enough
T2 - 13th Nordic Conference on Human-Computer Interaction, NordiCHI 2024
AU - Kaate, Ilkka
AU - Salminen, Joni
AU - Jung, Soon Gyo
AU - Rizun, Nina
AU - Revina, Aleksandra
AU - Jansen, Bernard J.
N1 - Publisher Copyright:
© 2024 Copyright held by the owner/author(s).
PY - 2024/10/13
Y1 - 2024/10/13
N2 - When using deepfake technology to represent users, there is a need to convey a reasonable range of emotions to be able to portray different circumstances ranging from positive to negative experiences (e.g., personal struggles). Because it is not known how well deepfake avatars embody emotional diversity, we investigated this aspect among 202 deepfake avatars. Our findings suggest an overall positivity bias in deepfake avatars’ emotions. We also found significant gender differences in several emotional expressions, with, male deepfakes scoring higher in “smile” and “calm” emotions, and female deepfake avatars scoring higher in “surprised”, “fear”, and “happy” emotions. In terms of ethnicity, European and Hispanic deepfake avatars demonstrate the broadest range of “smile”, “happy”, and “calm” compared to other ethnic groups. Age had no notable bias. No emotion score was normally distributed, suggesting that the range of emotional representativeness among the tested deepfake avatars is skewed. We outline the implications for academics and professionals regarding future development and responsible deployment of deepfake avatars.
AB - When using deepfake technology to represent users, there is a need to convey a reasonable range of emotions to be able to portray different circumstances ranging from positive to negative experiences (e.g., personal struggles). Because it is not known how well deepfake avatars embody emotional diversity, we investigated this aspect among 202 deepfake avatars. Our findings suggest an overall positivity bias in deepfake avatars’ emotions. We also found significant gender differences in several emotional expressions, with, male deepfakes scoring higher in “smile” and “calm” emotions, and female deepfake avatars scoring higher in “surprised”, “fear”, and “happy” emotions. In terms of ethnicity, European and Hispanic deepfake avatars demonstrate the broadest range of “smile”, “happy”, and “calm” compared to other ethnic groups. Age had no notable bias. No emotion score was normally distributed, suggesting that the range of emotional representativeness among the tested deepfake avatars is skewed. We outline the implications for academics and professionals regarding future development and responsible deployment of deepfake avatars.
KW - Deepfake avatars
KW - Emotional diversity
KW - Hci
KW - User representation
UR - http://www.scopus.com/inward/record.url?scp=85206574342&partnerID=8YFLogxK
U2 - 10.1145/3679318.3685398
DO - 10.1145/3679318.3685398
M3 - Conference contribution
AN - SCOPUS:85206574342
T3 - ACM International Conference Proceeding Series
BT - Proceedings Of The 13th Nordic Conference On Human-computer Interaction, Nordichi 2024
PB - Association for Computing Machinery
Y2 - 13 October 2024 through 16 October 2024
ER -