Visualizing Mental Health Insights: A Pipeline from Social Media to Chernoff Faces

Fatima Nagi, Mahmood Alzubaidi, Uzair Shah, Hurmat Shah, Majid Alabdulla, Mowafa Househ, Marco Agus*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This study proposes an approach for analyzing mental health through publicly available social media data, employing Large Language Models (LLMs) and visualization techniques to transform textual data into Chernoff Faces. The analysis began with a dataset comprising 15,744 posts sourced from major social media platforms, which was refined down to 2,621 posts through meticulous data cleaning, feature extraction, and visualization processes. Our methodology includes stages of Data Preparation, Feature Extraction, Chernoff Face Visualization, and Clinical Validation. Dimensionality reduction techniques such as PCA, t-SNE, and UMAP were employed to transform complex mental health data into comprehensible visual representations. Validation involved a survey among 60 volunteer psychiatrists, underscoring the visualizations' potential for enhancing clinical assessments. This work sets the stage for future evaluations, specifically focusing on a combined features method to further refine the visual representation of mental health conditions and to augment the diagnostic tools available to mental health professionals.

Original languageEnglish
Title of host publicationDigital Health and Informatics Innovations for Sustainable Health Care Systems - Proceedings of MIE 2024
EditorsJohn Mantas, Arie Hasman, George Demiris, Kaija Saranto, Michael Marschollek, Theodoros N. Arvanitis, Ivana Ognjanovic, Arriel Benis, Parisis Gallos, Emmanouil Zoulias, Elisavet Andrikopoulou
PublisherIOS Press BV
Pages1972-1976
Number of pages5
ISBN (Electronic)9781643685335
DOIs
Publication statusPublished - 22 Aug 2024
Event34th Medical Informatics Europe Conference, MIE 2024 - Athens, Greece
Duration: 25 Aug 202429 Aug 2024

Publication series

NameStudies in Health Technology and Informatics
Volume316
ISSN (Print)0926-9630
ISSN (Electronic)1879-8365

Conference

Conference34th Medical Informatics Europe Conference, MIE 2024
Country/TerritoryGreece
CityAthens
Period25/08/2429/08/24

Keywords

  • Chernoff Faces
  • LLM
  • Mental Health
  • Social Media
  • Visualization

Fingerprint

Dive into the research topics of 'Visualizing Mental Health Insights: A Pipeline from Social Media to Chernoff Faces'. Together they form a unique fingerprint.

Cite this