Automatic image filtering on social networks using deep learning and perceptual hashing during crises

Research output: Contribution to journalConference articlepeer-review

35 Citations (Scopus)

Abstract

The extensive use of social media platforms, especially during disasters, creates unique opportunities for humanitarian organizations to gain situational awareness and launch relief operations accordingly. In addition to the textual content, people post overwhelming amounts of imagery data on social networks within minutes of a disaster hit. Studies point to the importance of this online imagery content for emergency response. Despite recent advances in the computer vision field, automatic processing of the crisis-related social media imagery data remains a challenging task. It is because a majority of which consists of redundant and irrelevant content. In this paper, we present an image processing pipeline that comprises de-duplication and relevancy filtering mechanisms to collect and filter social media image content in real-time during a crisis event. Results obtained from extensive experiments on real-world crisis datasets demonstrate the significance of the proposed pipeline for optimal utilization of both human and machine computing resources.

Original languageEnglish
Pages (from-to)499-511
Number of pages13
JournalProceedings of the International ISCRAM Conference
Volume2017-May
Publication statusPublished - 2017
Event14th International Conference on Information Systems for Crisis Response and Management, ISCRAM 2017 - Albi, France
Duration: 21 May 201724 May 2017

Keywords

  • Disaster management
  • Image processing
  • Social media
  • Supervised classification

Fingerprint

Dive into the research topics of 'Automatic image filtering on social networks using deep learning and perceptual hashing during crises'. Together they form a unique fingerprint.

Cite this