结合无监督和监督深度学习方法的地表异常检测

Domen Rački, Dejan Tomazevic, D. Skočaj
{"title":"结合无监督和监督深度学习方法的地表异常检测","authors":"Domen Rački, Dejan Tomazevic, D. Skočaj","doi":"10.1117/12.2688559","DOIUrl":null,"url":null,"abstract":"Anomaly detection in an unsupervised manner has become the go-to approach in applications where data labeling proves problematic. However, these approaches aren’t completely unsupervised, since they rely on the weak knowledge of the dataset distribution into anomalous and anomaly-free subsets and typically require post-training threshold calibration in order to perform anomaly detection. Yet, they do not take advantage of available positive samples during training. In contrast, fully supervised approaches have proven to be more accurate and more efficient, however, they require a sufficient number of anomalous images to be labeled on a per-pixel level, which represents a labour-intensive task. In this paper, we propose a new hybrid approach that utilizes the best of both worlds. We use an unsupervised approach to build a model for generating pseudo labels, followed by a supervised approach in order to robustify anomaly detection. Moreover, we extend this approach with an active learning schema, that results in learning with mixed supervision. We achieve several improvements, i.e., the utilization of available positive image samples, improved anomaly detection performance, and the retention of real-time performance. The proposed approach yields results that are comparable to the fully supervised approach, and at the very least, reduces the number of required labeled anomalous samples.","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Combining unsupervised and supervised deep learning approaches for surface anomaly detection\",\"authors\":\"Domen Rački, Dejan Tomazevic, D. Skočaj\",\"doi\":\"10.1117/12.2688559\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Anomaly detection in an unsupervised manner has become the go-to approach in applications where data labeling proves problematic. However, these approaches aren’t completely unsupervised, since they rely on the weak knowledge of the dataset distribution into anomalous and anomaly-free subsets and typically require post-training threshold calibration in order to perform anomaly detection. Yet, they do not take advantage of available positive samples during training. In contrast, fully supervised approaches have proven to be more accurate and more efficient, however, they require a sufficient number of anomalous images to be labeled on a per-pixel level, which represents a labour-intensive task. In this paper, we propose a new hybrid approach that utilizes the best of both worlds. We use an unsupervised approach to build a model for generating pseudo labels, followed by a supervised approach in order to robustify anomaly detection. Moreover, we extend this approach with an active learning schema, that results in learning with mixed supervision. We achieve several improvements, i.e., the utilization of available positive image samples, improved anomaly detection performance, and the retention of real-time performance. The proposed approach yields results that are comparable to the fully supervised approach, and at the very least, reduces the number of required labeled anomalous samples.\",\"PeriodicalId\":295011,\"journal\":{\"name\":\"International Conference on Quality Control by Artificial Vision\",\"volume\":\"4 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-07-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Conference on Quality Control by Artificial Vision\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2688559\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Quality Control by Artificial Vision","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2688559","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在数据标记存在问题的应用中,以无监督的方式进行异常检测已成为首选方法。然而,这些方法并不是完全无监督的,因为它们依赖于数据集分布到异常和无异常子集的弱知识,并且通常需要训练后阈值校准才能执行异常检测。然而,他们在训练过程中没有利用现有的阳性样本。相比之下,完全监督的方法已被证明更准确和更有效,但是,它们需要足够数量的异常图像在每像素水平上进行标记,这是一项劳动密集型的任务。在本文中,我们提出了一种新的混合方法,利用了这两个世界的优点。我们使用无监督的方法来建立一个模型来生成伪标签,然后使用有监督的方法来鲁棒异常检测。此外,我们将这种方法扩展为主动学习模式,从而实现混合监督学习。我们实现了几个改进,即利用可用的正图像样本,改进异常检测性能,并保持实时性能。所提出的方法产生的结果与完全监督方法相当,并且至少减少了所需标记异常样本的数量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Combining unsupervised and supervised deep learning approaches for surface anomaly detection
Anomaly detection in an unsupervised manner has become the go-to approach in applications where data labeling proves problematic. However, these approaches aren’t completely unsupervised, since they rely on the weak knowledge of the dataset distribution into anomalous and anomaly-free subsets and typically require post-training threshold calibration in order to perform anomaly detection. Yet, they do not take advantage of available positive samples during training. In contrast, fully supervised approaches have proven to be more accurate and more efficient, however, they require a sufficient number of anomalous images to be labeled on a per-pixel level, which represents a labour-intensive task. In this paper, we propose a new hybrid approach that utilizes the best of both worlds. We use an unsupervised approach to build a model for generating pseudo labels, followed by a supervised approach in order to robustify anomaly detection. Moreover, we extend this approach with an active learning schema, that results in learning with mixed supervision. We achieve several improvements, i.e., the utilization of available positive image samples, improved anomaly detection performance, and the retention of real-time performance. The proposed approach yields results that are comparable to the fully supervised approach, and at the very least, reduces the number of required labeled anomalous samples.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信