TY - JOUR
T1 - Attention Level Evaluation in Children With Autism
T2 - Leveraging Head Pose and Gaze Parameters From Videos for Educational Intervention
AU - Varghese, Elizabeth B.
AU - Qaraqe, Marwa
AU - Al-Thani, Dena
N1 - Publisher Copyright:
© 2008-2011 IEEE.
PY - 2024/6/5
Y1 - 2024/6/5
N2 - In children with autism spectrum disorders (ASDs), assessing attention is crucial to understanding their behavioral and cognitive functioning. Attention difficulties are a common challenge for children with autism, significantly impacting their learning and social interactions. Traditional assessment methods often require skilled professionals to provide personalized interventions, which can be time consuming. In addition, existing approaches based on video and eye-tracking data have limitations in providing accurate educational interventions. This article proposes a noninvasive and objective method to assess and quantify attention levels in children with autism by utilizing head poses and gaze parameters. The proposed approach combines a deep learning model for extracting head pose parameters, algorithms to extract gaze parameters, machine learning models for the attention assessment task, and an ensemble of Bayesian neural networks for attention quantification. We conducted experiments involving 39 children (19 with ASD and 20 neurotypical children) by assigning various attention tasks and capturing their video and eye patterns using a webcam and an eye tracker. Results are analyzed for participant and task differences, which demonstrate that the proposed approach is successful in measuring a child's attention control and inattention. Ultimately, the developed attention assessment method using head poses and gaze parameters opens the door to developing real-time attention recognition systems that can enhance learning and provide targeted interventions.
AB - In children with autism spectrum disorders (ASDs), assessing attention is crucial to understanding their behavioral and cognitive functioning. Attention difficulties are a common challenge for children with autism, significantly impacting their learning and social interactions. Traditional assessment methods often require skilled professionals to provide personalized interventions, which can be time consuming. In addition, existing approaches based on video and eye-tracking data have limitations in providing accurate educational interventions. This article proposes a noninvasive and objective method to assess and quantify attention levels in children with autism by utilizing head poses and gaze parameters. The proposed approach combines a deep learning model for extracting head pose parameters, algorithms to extract gaze parameters, machine learning models for the attention assessment task, and an ensemble of Bayesian neural networks for attention quantification. We conducted experiments involving 39 children (19 with ASD and 20 neurotypical children) by assigning various attention tasks and capturing their video and eye patterns using a webcam and an eye tracker. Results are analyzed for participant and task differences, which demonstrate that the proposed approach is successful in measuring a child's attention control and inattention. Ultimately, the developed attention assessment method using head poses and gaze parameters opens the door to developing real-time attention recognition systems that can enhance learning and provide targeted interventions.
KW - Attention assessment
KW - Autism
KW - Bayesian neural network (BNN)
KW - Brain modeling
KW - Education
KW - Face recognition
KW - Feature extraction
KW - Magnetic heads
KW - Task analysis
KW - Videos
KW - autism spectrum disorder (ASD)
KW - machine learning (ML)
UR - http://www.scopus.com/inward/record.url?scp=85195394686&partnerID=8YFLogxK
U2 - 10.1109/TLT.2024.3409702
DO - 10.1109/TLT.2024.3409702
M3 - Article
AN - SCOPUS:85195394686
SN - 1939-1382
VL - 17
SP - 1777
EP - 1793
JO - IEEE Transactions on Learning Technologies
JF - IEEE Transactions on Learning Technologies
ER -