Ankur Mondal, Athishay Kesan, Andrea Rodrigues, Jossy P. George
{"title":"灾害相关推文的高效多模态分类方法","authors":"Ankur Mondal, Athishay Kesan, Andrea Rodrigues, Jossy P. George","doi":"10.1109/icdcece53908.2022.9792951","DOIUrl":null,"url":null,"abstract":"Owing to the unanticipated and thereby treacherous nature of disasters, it is essential to gather necessary information and data regarding the same on an urgent basis; this helps to get a detailed overview of the situation and helps humanitarian organizations prioritize their tasks. In this paper, \"An Efficient Multi-Modal Classification Approach for Disaster-related Tweets,\" the proposed framework based on Deep Learning to classify disaster-related tweets by analyzing text and image contents. The approach is based on Gated Recurrent Unit (GRU) and GloVe Embedding for text classification and VGG-16 network for image classification. Finally, a combined model is proposed using both text and image modules by the Late Fusion Technique. This portrays that the proposed multi-modal system performs significantly well in classifying disaster-related content.","PeriodicalId":417643,"journal":{"name":"2022 IEEE International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"An Efficient Multi-Modal Classification Approach for Disaster-related Tweets\",\"authors\":\"Ankur Mondal, Athishay Kesan, Andrea Rodrigues, Jossy P. George\",\"doi\":\"10.1109/icdcece53908.2022.9792951\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Owing to the unanticipated and thereby treacherous nature of disasters, it is essential to gather necessary information and data regarding the same on an urgent basis; this helps to get a detailed overview of the situation and helps humanitarian organizations prioritize their tasks. In this paper, \\\"An Efficient Multi-Modal Classification Approach for Disaster-related Tweets,\\\" the proposed framework based on Deep Learning to classify disaster-related tweets by analyzing text and image contents. The approach is based on Gated Recurrent Unit (GRU) and GloVe Embedding for text classification and VGG-16 network for image classification. Finally, a combined model is proposed using both text and image modules by the Late Fusion Technique. This portrays that the proposed multi-modal system performs significantly well in classifying disaster-related content.\",\"PeriodicalId\":417643,\"journal\":{\"name\":\"2022 IEEE International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-04-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/icdcece53908.2022.9792951\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/icdcece53908.2022.9792951","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
摘要
由于灾害无法预料,因而具有危险的性质,因此必须紧急收集有关灾害的必要资料和数据;这有助于详细了解局势,并帮助人道主义组织确定任务的优先次序。在本文“a Efficient Multi-Modal Classification Approach for Disaster-related Tweets”中,提出了基于深度学习的框架,通过分析文本和图像内容对灾害相关Tweets进行分类。该方法基于门控循环单元(GRU)和手套嵌入(GloVe Embedding)进行文本分类,基于VGG-16网络进行图像分类。最后,利用后期融合技术提出了文本和图像模块的组合模型。这表明所提出的多模态系统在分类与灾害相关的内容方面表现得非常好。
An Efficient Multi-Modal Classification Approach for Disaster-related Tweets
Owing to the unanticipated and thereby treacherous nature of disasters, it is essential to gather necessary information and data regarding the same on an urgent basis; this helps to get a detailed overview of the situation and helps humanitarian organizations prioritize their tasks. In this paper, "An Efficient Multi-Modal Classification Approach for Disaster-related Tweets," the proposed framework based on Deep Learning to classify disaster-related tweets by analyzing text and image contents. The approach is based on Gated Recurrent Unit (GRU) and GloVe Embedding for text classification and VGG-16 network for image classification. Finally, a combined model is proposed using both text and image modules by the Late Fusion Technique. This portrays that the proposed multi-modal system performs significantly well in classifying disaster-related content.