Getting Emotional Enough: Analyzing Emotional Diversity in Deepfake Avatars

Ilkka Kaate, Joni Salminen, Soon Gyo Jung, Nina Rizun, Aleksandra Revina, Bernard J. Jansen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

When using deepfake technology to represent users, there is a need to convey a reasonable range of emotions to be able to portray different circumstances ranging from positive to negative experiences (e.g., personal struggles). Because it is not known how well deepfake avatars embody emotional diversity, we investigated this aspect among 202 deepfake avatars. Our findings suggest an overall positivity bias in deepfake avatars’ emotions. We also found significant gender differences in several emotional expressions, with, male deepfakes scoring higher in “smile” and “calm” emotions, and female deepfake avatars scoring higher in “surprised”, “fear”, and “happy” emotions. In terms of ethnicity, European and Hispanic deepfake avatars demonstrate the broadest range of “smile”, “happy”, and “calm” compared to other ethnic groups. Age had no notable bias. No emotion score was normally distributed, suggesting that the range of emotional representativeness among the tested deepfake avatars is skewed. We outline the implications for academics and professionals regarding future development and responsible deployment of deepfake avatars.

Original languageEnglish
Title of host publicationProceedings Of The 13th Nordic Conference On Human-computer Interaction, Nordichi 2024
Subtitle of host publicationProceedings of the 13th Nordic Conference on Human-Computer Interaction, NordiCHI 2024
PublisherAssociation for Computing Machinery
Number of pages12
ISBN (Electronic)9798400709661
DOIs
Publication statusPublished - 13 Oct 2024
Event13th Nordic Conference on Human-Computer Interaction, NordiCHI 2024 - Uppsala, Sweden
Duration: 13 Oct 202416 Oct 2024

Publication series

NameACM International Conference Proceeding Series

Conference

Conference13th Nordic Conference on Human-Computer Interaction, NordiCHI 2024
Country/TerritorySweden
CityUppsala
Period13/10/2416/10/24

Keywords

  • Deepfake avatars
  • Emotional diversity
  • Hci
  • User representation

Fingerprint

Dive into the research topics of 'Getting Emotional Enough: Analyzing Emotional Diversity in Deepfake Avatars'. Together they form a unique fingerprint.

Cite this