Attention Level Evaluation in Children With Autism: Leveraging Head Pose and Gaze Parameters From Videos for Educational Intervention

Elizabeth B. Varghese*, Marwa Qaraqe, Dena Al-Thani

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

In children with autism spectrum disorders (ASDs), assessing attention is crucial to understanding their behavioral and cognitive functioning. Attention difficulties are a common challenge for children with autism, significantly impacting their learning and social interactions. Traditional assessment methods often require skilled professionals to provide personalized interventions, which can be time consuming. In addition, existing approaches based on video and eye-tracking data have limitations in providing accurate educational interventions. This article proposes a noninvasive and objective method to assess and quantify attention levels in children with autism by utilizing head poses and gaze parameters. The proposed approach combines a deep learning model for extracting head pose parameters, algorithms to extract gaze parameters, machine learning models for the attention assessment task, and an ensemble of Bayesian neural networks for attention quantification. We conducted experiments involving 39 children (19 with ASD and 20 neurotypical children) by assigning various attention tasks and capturing their video and eye patterns using a webcam and an eye tracker. Results are analyzed for participant and task differences, which demonstrate that the proposed approach is successful in measuring a child's attention control and inattention. Ultimately, the developed attention assessment method using head poses and gaze parameters opens the door to developing real-time attention recognition systems that can enhance learning and provide targeted interventions.

Original languageEnglish
Pages (from-to)1777-1793
Number of pages17
JournalIEEE Transactions on Learning Technologies
Volume17
DOIs
Publication statusPublished - 5 Jun 2024

Keywords

  • Attention assessment
  • Autism
  • Bayesian neural network (BNN)
  • Brain modeling
  • Education
  • Face recognition
  • Feature extraction
  • Magnetic heads
  • Task analysis
  • Videos
  • autism spectrum disorder (ASD)
  • machine learning (ML)

Fingerprint

Dive into the research topics of 'Attention Level Evaluation in Children With Autism: Leveraging Head Pose and Gaze Parameters From Videos for Educational Intervention'. Together they form a unique fingerprint.

Cite this