{"title":"解决监控图像模糊分类中的不平衡数据集问题","authors":"","doi":"10.1016/j.engappai.2024.109345","DOIUrl":null,"url":null,"abstract":"<div><p>Surveillance videos taken in unconstrained environments can be tampered with due to different environmental factors and malicious human activities. They often blur the video content and introduce difficulty in identifying the events in the scene. The problem is particularly acute for smart surveillance systems that need to make real-time decisions based on the video. Automatic detection and classification of the blur anomalies in the video are crucial to these systems. Traditional learning-based classification methods often face imbalance problems in the sample numbers and distributions among the data classes in the dataset that severely affect their training and hence the classification performance. In this paper, a new learning-based approach for surveillance image blur classification is proposed. The imbalanced dataset problem is tackled both at the data and algorithm levels. At the data level, two synthesizers are developed to generate the required negative surveillance images to balance the sample numbers for all classes. At the algorithm level, an attention-based structure making use of the special feature of the minority class is proposed to improve the classification accuracy. Our experiment results show that the proposed approach significantly outperforms state-of-the-art methods for blur classification while keeping the model size small for edge applications.</p></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":null,"pages":null},"PeriodicalIF":7.5000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Solving the imbalanced dataset problem in surveillance image blur classification\",\"authors\":\"\",\"doi\":\"10.1016/j.engappai.2024.109345\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Surveillance videos taken in unconstrained environments can be tampered with due to different environmental factors and malicious human activities. They often blur the video content and introduce difficulty in identifying the events in the scene. The problem is particularly acute for smart surveillance systems that need to make real-time decisions based on the video. Automatic detection and classification of the blur anomalies in the video are crucial to these systems. Traditional learning-based classification methods often face imbalance problems in the sample numbers and distributions among the data classes in the dataset that severely affect their training and hence the classification performance. In this paper, a new learning-based approach for surveillance image blur classification is proposed. The imbalanced dataset problem is tackled both at the data and algorithm levels. At the data level, two synthesizers are developed to generate the required negative surveillance images to balance the sample numbers for all classes. At the algorithm level, an attention-based structure making use of the special feature of the minority class is proposed to improve the classification accuracy. Our experiment results show that the proposed approach significantly outperforms state-of-the-art methods for blur classification while keeping the model size small for edge applications.</p></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2024-09-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197624015033\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197624015033","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Solving the imbalanced dataset problem in surveillance image blur classification
Surveillance videos taken in unconstrained environments can be tampered with due to different environmental factors and malicious human activities. They often blur the video content and introduce difficulty in identifying the events in the scene. The problem is particularly acute for smart surveillance systems that need to make real-time decisions based on the video. Automatic detection and classification of the blur anomalies in the video are crucial to these systems. Traditional learning-based classification methods often face imbalance problems in the sample numbers and distributions among the data classes in the dataset that severely affect their training and hence the classification performance. In this paper, a new learning-based approach for surveillance image blur classification is proposed. The imbalanced dataset problem is tackled both at the data and algorithm levels. At the data level, two synthesizers are developed to generate the required negative surveillance images to balance the sample numbers for all classes. At the algorithm level, an attention-based structure making use of the special feature of the minority class is proposed to improve the classification accuracy. Our experiment results show that the proposed approach significantly outperforms state-of-the-art methods for blur classification while keeping the model size small for edge applications.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.