Automatic analysis of social media images to identify disaster type and infer appropriate emergency response

Asif, Amna and Khatoon, Shaheen and Hasan, Md Maruf and Alshamari, Majed A. and Abdou, Sherif and Elsayed, Khaled Mostafa and Rashwan, Mohsen (2021) Automatic analysis of social media images to identify disaster type and infer appropriate emergency response. Journal of Big Data, 8 (1). ISSN 2196-1115

Full text not available from this repository.

Abstract

Social media postings are increasingly being used in modern days disaster management. Along with the textual information, the contexts and cues inherent in the images posted on social media play an important role in identifying appropriate emergency responses to a particular disaster. In this paper, we proposed a disaster taxonomy of emergency response and used the same taxonomy with an emergency response pipeline together with deep-learning-based image classification and object identification algorithms to automate the emergency response decision-making process. We used the card sorting method to validate the completeness and correctness of the disaster taxonomy. We also used VGG-16 and You Only Look Once (YOLO) algorithms to analyze disaster-related images and identify disaster types and relevant cues (such as objects that appeared in those images). Furthermore, using decision tables and applied analytic hierarchy processes (AHP), we aligned the intermediate outputs to map a disaster-related image into the disaster taxonomy and determine an appropriate type of emergency response for a given disaster. The proposed approach has been validated using Earthquake, Hurricane, and Typhoon as use cases. The results show that 96% of images were categorized correctly on disaster taxonomy using YOLOv4. The accuracy can be further improved using an incremental training approach. Due to the use of cloud-based deep learning algorithms in image analysis, our approach can potentially be useful to real-time crisis management. The algorithms along with the proposed emergency response pipeline can be further enhanced with other spatiotemporal features extracted from multimedia information posted on social media.

Item Type:
Journal Article
Journal or Publication Title:
Journal of Big Data
Uncontrolled Keywords:
/dk/atira/pure/subjectarea/asjc/1800/1802
Subjects:
ID Code:
183370
Deposited By:
Deposited On:
17 Jan 2023 12:10
Refereed?:
Yes
Published?:
Published
Last Modified:
17 Jan 2023 12:10