{"title":"社交媒体平台上的图像伪造——一种检测和定位的深度学习方法","authors":"Bhuvanesh Singh, D. Sharma","doi":"10.1109/INDIACom51348.2021.00125","DOIUrl":null,"url":null,"abstract":"Social media platforms play a significant role in spreading news in the current digital era. However, they have also been spreading fake images. Forged images posted on social media platform such as Twitter create misrepresentation and generate harmful user emotions. Thus, detecting fake images over social media platforms has become a critical need of time. Deep learning convolutional networks can learn the intrinsic feature set of images and can detect forged images. This paper proposes a convolutional neural network to spot fake images shared over social media platforms. High pass filters from image processing are used in the first layer for weight initialization. This helps the neural network converge faster and achieve better accuracy. Interpretability is a common concern in deep learning models. The proposed framework employs Gradient-weighted Class Activation Mapping to generate heatmaps and localize the image's manipulated area. The model is verified against the publicly available CASIA dataset. An accuracy of 92.3% is achieved, which is better than the other previous models. From the social media perspective, the model is verified against the latest Twitter dataset. The experiment proves that convolutional neural networks perform well in detecting forged images over social media platforms, and interpretability can be achieved.","PeriodicalId":415594,"journal":{"name":"2021 8th International Conference on Computing for Sustainable Global Development (INDIACom)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Image Forgery over Social Media Platforms - A Deep Learning Approach for its Detection and Localization\",\"authors\":\"Bhuvanesh Singh, D. Sharma\",\"doi\":\"10.1109/INDIACom51348.2021.00125\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Social media platforms play a significant role in spreading news in the current digital era. However, they have also been spreading fake images. Forged images posted on social media platform such as Twitter create misrepresentation and generate harmful user emotions. Thus, detecting fake images over social media platforms has become a critical need of time. Deep learning convolutional networks can learn the intrinsic feature set of images and can detect forged images. This paper proposes a convolutional neural network to spot fake images shared over social media platforms. High pass filters from image processing are used in the first layer for weight initialization. This helps the neural network converge faster and achieve better accuracy. Interpretability is a common concern in deep learning models. The proposed framework employs Gradient-weighted Class Activation Mapping to generate heatmaps and localize the image's manipulated area. The model is verified against the publicly available CASIA dataset. An accuracy of 92.3% is achieved, which is better than the other previous models. From the social media perspective, the model is verified against the latest Twitter dataset. The experiment proves that convolutional neural networks perform well in detecting forged images over social media platforms, and interpretability can be achieved.\",\"PeriodicalId\":415594,\"journal\":{\"name\":\"2021 8th International Conference on Computing for Sustainable Global Development (INDIACom)\",\"volume\":\"2 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-03-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 8th International Conference on Computing for Sustainable Global Development (INDIACom)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/INDIACom51348.2021.00125\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 8th International Conference on Computing for Sustainable Global Development (INDIACom)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/INDIACom51348.2021.00125","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Image Forgery over Social Media Platforms - A Deep Learning Approach for its Detection and Localization
Social media platforms play a significant role in spreading news in the current digital era. However, they have also been spreading fake images. Forged images posted on social media platform such as Twitter create misrepresentation and generate harmful user emotions. Thus, detecting fake images over social media platforms has become a critical need of time. Deep learning convolutional networks can learn the intrinsic feature set of images and can detect forged images. This paper proposes a convolutional neural network to spot fake images shared over social media platforms. High pass filters from image processing are used in the first layer for weight initialization. This helps the neural network converge faster and achieve better accuracy. Interpretability is a common concern in deep learning models. The proposed framework employs Gradient-weighted Class Activation Mapping to generate heatmaps and localize the image's manipulated area. The model is verified against the publicly available CASIA dataset. An accuracy of 92.3% is achieved, which is better than the other previous models. From the social media perspective, the model is verified against the latest Twitter dataset. The experiment proves that convolutional neural networks perform well in detecting forged images over social media platforms, and interpretability can be achieved.