Artificial Intelligence-Based Mobile Application for Sensing Children Emotion Through Drawings

Nashva Ali, Alaa Abd-Alrazaq, Zubair Shah, Mohannad Alajlani, Tanvir Alam, Mowafa Househ*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Children go through varied emotions such as happiness, sadness, and fear. At times, it may be difficult for children to express their emotions. Detecting and understanding the unexpressed emotions of children is very important to address their needs and prevent mental health issues. In this paper, we develop an artificial intelligence (AI) based Emotion Sensing Recognition App (ESRA) to help parents and teachers understand the emotions of children by analyzing their drawings. We collected 102 drawings from a local school in Doha and 521 drawings from Google and Instagram. Four different experiments were conducted using a combination of the two datasets. The deep learning model was trained using the Fastai library in Python. The model classifies the drawings into positive or negative emotions. The model accuracy ranged from 55% to 79% in the four experiments. This study showed that ESRA has the potential in identifying the emotions of children. However, the underlying algorithm needs to be trained and evaluated using more drawings to improve its current accuracy and to be able to identify more specific emotions.

Original languageEnglish
Title of host publicationAdvances in Informatics, Management and Technology in Healthcare
EditorsJohn Mantas, Parisis Gallos, Emmanouil Zoulias, Arie Hasman, Mowafa S. Househ, Marianna Diomidous, Joseph Liaskos, Martha Charalampidou
PublisherIOS Press BV
Pages118-121
Number of pages4
ISBN (Electronic)9781643682907
DOIs
Publication statusPublished - 2022

Publication series

NameStudies in Health Technology and Informatics
Volume295
ISSN (Print)0926-9630
ISSN (Electronic)1879-8365

Keywords

  • Artificial Intelligence
  • Children
  • Emotion Sensing
  • Mobile Application

Fingerprint

Dive into the research topics of 'Artificial Intelligence-Based Mobile Application for Sensing Children Emotion Through Drawings'. Together they form a unique fingerprint.

Cite this