J. Weston, K. W. Smith, S. Smartt, J. Tonry, H. Stevance
{"title":"在 ATLAS 勘测中训练卷积神经网络进行真实迷惑分类","authors":"J. Weston, K. W. Smith, S. Smartt, J. Tonry, H. Stevance","doi":"10.1093/rasti/rzae027","DOIUrl":null,"url":null,"abstract":"\n We present a Convolutional Neural Network (CNN) for use in the Real-Bogus classification of transient detections made by the Asteroid Terrestrial Impact Last Alert System (ATLAS) and subsequent efforts to improve performance since initial development. In transient detection surveys the number of alerts made outstrips the capacity for human scanning, necessitating the use of machine learning aids to reduce the number of false positives presented to annotators. We take a sample of recently annotated data from each of the three operating ATLAS telescope with ∼340,000 real (known transients) and ∼1,030,000 bogus detections per model. We retrained the CNN architecture with these data specific to each ATLAS unit, achieving a median False Positive Rate (FPR) of 0.72 per cent for a 1.00 per cent missed detection rate. Further investigations indicate if we reduce the input image size it results in increases to the false positive rate. Finally architecture adjustments and comparisons to contemporary CNNs indicate our retrained classifier is providing an optimal FPR. We conclude that the periodic retraining and readjustment of classification models on survey data can yield significant improvements as data drift arising from changes to optical and detector performance can lead to new features in the model and subsequent deteriorations in performance.","PeriodicalId":500957,"journal":{"name":"RAS Techniques and Instruments","volume":"12 9","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Training a convolutional neural network for real-bogus classification in the ATLAS survey\",\"authors\":\"J. Weston, K. W. Smith, S. Smartt, J. Tonry, H. Stevance\",\"doi\":\"10.1093/rasti/rzae027\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n We present a Convolutional Neural Network (CNN) for use in the Real-Bogus classification of transient detections made by the Asteroid Terrestrial Impact Last Alert System (ATLAS) and subsequent efforts to improve performance since initial development. In transient detection surveys the number of alerts made outstrips the capacity for human scanning, necessitating the use of machine learning aids to reduce the number of false positives presented to annotators. We take a sample of recently annotated data from each of the three operating ATLAS telescope with ∼340,000 real (known transients) and ∼1,030,000 bogus detections per model. We retrained the CNN architecture with these data specific to each ATLAS unit, achieving a median False Positive Rate (FPR) of 0.72 per cent for a 1.00 per cent missed detection rate. Further investigations indicate if we reduce the input image size it results in increases to the false positive rate. Finally architecture adjustments and comparisons to contemporary CNNs indicate our retrained classifier is providing an optimal FPR. We conclude that the periodic retraining and readjustment of classification models on survey data can yield significant improvements as data drift arising from changes to optical and detector performance can lead to new features in the model and subsequent deteriorations in performance.\",\"PeriodicalId\":500957,\"journal\":{\"name\":\"RAS Techniques and Instruments\",\"volume\":\"12 9\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"RAS Techniques and Instruments\",\"FirstCategoryId\":\"0\",\"ListUrlMain\":\"https://doi.org/10.1093/rasti/rzae027\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"RAS Techniques and Instruments","FirstCategoryId":"0","ListUrlMain":"https://doi.org/10.1093/rasti/rzae027","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Training a convolutional neural network for real-bogus classification in the ATLAS survey
We present a Convolutional Neural Network (CNN) for use in the Real-Bogus classification of transient detections made by the Asteroid Terrestrial Impact Last Alert System (ATLAS) and subsequent efforts to improve performance since initial development. In transient detection surveys the number of alerts made outstrips the capacity for human scanning, necessitating the use of machine learning aids to reduce the number of false positives presented to annotators. We take a sample of recently annotated data from each of the three operating ATLAS telescope with ∼340,000 real (known transients) and ∼1,030,000 bogus detections per model. We retrained the CNN architecture with these data specific to each ATLAS unit, achieving a median False Positive Rate (FPR) of 0.72 per cent for a 1.00 per cent missed detection rate. Further investigations indicate if we reduce the input image size it results in increases to the false positive rate. Finally architecture adjustments and comparisons to contemporary CNNs indicate our retrained classifier is providing an optimal FPR. We conclude that the periodic retraining and readjustment of classification models on survey data can yield significant improvements as data drift arising from changes to optical and detector performance can lead to new features in the model and subsequent deteriorations in performance.