Emotion unfolding and affective scenes: A case study in spoken conversations

Morena Danieli, Giuseppe Riccardi, Firoj Alam

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

17 Citations (Scopus)

Abstract

The manifestation of human emotions evolves over time and space. Most of the work on affective computing research is limited to the association of context-free signal segments, such as utterances and images, to basic emotions. In this paper, we discuss the hypothesis that interpreting emotions requires a conceptual description of their dynamics within the context of their manifestations. We describe the unfolding of emotions through the proposed affective scene framework. Affective scenes are defined in terms of who first expresses the variation in their emotional state in a conversation, how this affects the other speaker's emotional appraisal and response, and which modifications occur from the initial through the final state of the scene. This conceptual framework is applied and evaluated on real human-human conversations drawn from call centers. We show that the automatic classification of affective scenes achieves more than satisfactory results and it benefits from acoustic, lexical and psycholinguistic features of the speech and linguistics signals.

Original languageEnglish
Title of host publicationERM4CT 2015 - Proceedings of the International Workshop on Emotion Representations and Modelling for Companion Technologies, co-located with ICMI 2015
PublisherAssociation for Computing Machinery, Inc
Pages5-11
Number of pages7
ISBN (Electronic)9781450339889
DOIs
Publication statusPublished - 13 Nov 2015
Externally publishedYes
EventInternational Workshop on Emotion Representations and Modelling for Companion Technologies, ERM4CT 2015 - Seattle, United States
Duration: 13 Nov 2015 → …

Publication series

NameERM4CT 2015 - Proceedings of the International Workshop on Emotion Representations and Modelling for Companion Technologies, co-located with ICMI 2015

Conference

ConferenceInternational Workshop on Emotion Representations and Modelling for Companion Technologies, ERM4CT 2015
Country/TerritoryUnited States
CitySeattle
Period13/11/15 → …

Keywords

  • Affective Scene
  • Computational
  • Emotion
  • Machine Learning
  • Paralinguistics
  • Spoken Conversation

Fingerprint

Dive into the research topics of 'Emotion unfolding and affective scenes: A case study in spoken conversations'. Together they form a unique fingerprint.

Cite this