Che-Won Park , Hyung-Sup Jung , Won-Jin Lee , Kwang-Jae Lee , Kwan-Young Oh , Joong-Sun Won
{"title":"利用深度学习模型从高分辨率光学卫星图像中检测和估算烟囱大小","authors":"Che-Won Park , Hyung-Sup Jung , Won-Jin Lee , Kwang-Jae Lee , Kwan-Young Oh , Joong-Sun Won","doi":"10.1016/j.engappai.2024.109686","DOIUrl":null,"url":null,"abstract":"<div><div>This study shows an efficient method to estimate the location and size of chimneys from high-resolution satellite optical images using deep learning models. Korean multi-purpose satellite (KOMPSAT) −3 and -3A satellite images with spatial resolutions of 0.7 m and 0.55 m were used for model performance estimation, and the You Only Look Once version 8 (YOLOv8) and Residual Network (ResNet) regression models were integrated for the detection and size estimation of the chimneys. In the chimney detection and size estimation, we compared the model performances between 1) imbalanced and balanced data, 2) South Korea and Thailand data, and 3) KOMPSAT-3 and -3A data. We also analyzed the model performance according to the ResNet convolutional layers in chimney size estimation. In chimney detection, the model performances between the imbalanced and balanced data, South Korea and Thailand data, and KOMPSAT-3 and -3A data were about 0.723 and 0.739, 0.674 and 0.805, and 0.702 and 0.786 in the average precision (AP) 50–95 measure, respectively. The model performance between the South Korea and Thailand data showed a significant difference, likely because the chimneys in South Korea are very diverse, making it harder to generalize the YOLOv8 model. Furthermore, the model root mean square errors (RMSE) between the imbalanced and balanced data, South Korea and Thailand data, and KOMPSAT-3 and -3A data were about 2.917 and 2.788, 2.690 and 2.951, and 2.913 and 2.580 in chimney height, respectively, and about 1.285 and 1.190, 1.228 and 1.120, and 1.291 and 1.013 in chimney diameter, respectively. Keywords: Chimneys; deep learning; You Only Look Once version 8; Residual Network; Korean Multi-purpose Satellite-3/3A; object detection; regression model.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"139 ","pages":"Article 109686"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Chimney detection and size estimation from high-resolution optical satellite imagery using deep learning models\",\"authors\":\"Che-Won Park , Hyung-Sup Jung , Won-Jin Lee , Kwang-Jae Lee , Kwan-Young Oh , Joong-Sun Won\",\"doi\":\"10.1016/j.engappai.2024.109686\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>This study shows an efficient method to estimate the location and size of chimneys from high-resolution satellite optical images using deep learning models. Korean multi-purpose satellite (KOMPSAT) −3 and -3A satellite images with spatial resolutions of 0.7 m and 0.55 m were used for model performance estimation, and the You Only Look Once version 8 (YOLOv8) and Residual Network (ResNet) regression models were integrated for the detection and size estimation of the chimneys. In the chimney detection and size estimation, we compared the model performances between 1) imbalanced and balanced data, 2) South Korea and Thailand data, and 3) KOMPSAT-3 and -3A data. We also analyzed the model performance according to the ResNet convolutional layers in chimney size estimation. In chimney detection, the model performances between the imbalanced and balanced data, South Korea and Thailand data, and KOMPSAT-3 and -3A data were about 0.723 and 0.739, 0.674 and 0.805, and 0.702 and 0.786 in the average precision (AP) 50–95 measure, respectively. The model performance between the South Korea and Thailand data showed a significant difference, likely because the chimneys in South Korea are very diverse, making it harder to generalize the YOLOv8 model. Furthermore, the model root mean square errors (RMSE) between the imbalanced and balanced data, South Korea and Thailand data, and KOMPSAT-3 and -3A data were about 2.917 and 2.788, 2.690 and 2.951, and 2.913 and 2.580 in chimney height, respectively, and about 1.285 and 1.190, 1.228 and 1.120, and 1.291 and 1.013 in chimney diameter, respectively. Keywords: Chimneys; deep learning; You Only Look Once version 8; Residual Network; Korean Multi-purpose Satellite-3/3A; object detection; regression model.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"139 \",\"pages\":\"Article 109686\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2024-11-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S095219762401844X\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S095219762401844X","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
摘要
本研究展示了一种利用深度学习模型从高分辨率卫星光学图像中估算烟囱位置和大小的有效方法。我们使用空间分辨率分别为 0.7 m 和 0.55 m 的韩国多用途卫星(KOMPSAT)-3 和-3A 卫星图像进行了模型性能评估,并整合了 You Only Look Once version 8(YOLOv8)和 Residual Network(ResNet)回归模型,用于烟囱的检测和尺寸估算。在烟囱检测和大小估计中,我们比较了 1)不平衡数据和平衡数据;2)韩国和泰国数据;3)KOMPSAT-3 和 -3A 数据的模型性能。我们还分析了 ResNet 卷积层在烟囱大小估计中的模型性能。在烟囱检测中,不平衡数据和平衡数据、韩国和泰国数据以及 KOMPSAT-3 和 -3A 数据之间的模型性能在平均精度(AP)50-95 测量中分别约为 0.723 和 0.739,0.674 和 0.805,以及 0.702 和 0.786。韩国和泰国数据之间的模型性能存在显著差异,这可能是因为韩国的烟囱种类繁多,使得 YOLOv8 模型难以推广。此外,不平衡和平衡数据、韩国和泰国数据以及 KOMPSAT-3 和 -3A 数据之间的模型均方根误差(RMSE)在烟囱高度上分别约为 2.917 和 2.788、2.690 和 2.951、2.913 和 2.580,在烟囱直径上分别约为 1.285 和 1.190、1.228 和 1.120、1.291 和 1.013。关键词烟囱;深度学习;You Only Look Once version 8;残差网络;韩国多用途卫星-3/3A;物体检测;回归模型。
Chimney detection and size estimation from high-resolution optical satellite imagery using deep learning models
This study shows an efficient method to estimate the location and size of chimneys from high-resolution satellite optical images using deep learning models. Korean multi-purpose satellite (KOMPSAT) −3 and -3A satellite images with spatial resolutions of 0.7 m and 0.55 m were used for model performance estimation, and the You Only Look Once version 8 (YOLOv8) and Residual Network (ResNet) regression models were integrated for the detection and size estimation of the chimneys. In the chimney detection and size estimation, we compared the model performances between 1) imbalanced and balanced data, 2) South Korea and Thailand data, and 3) KOMPSAT-3 and -3A data. We also analyzed the model performance according to the ResNet convolutional layers in chimney size estimation. In chimney detection, the model performances between the imbalanced and balanced data, South Korea and Thailand data, and KOMPSAT-3 and -3A data were about 0.723 and 0.739, 0.674 and 0.805, and 0.702 and 0.786 in the average precision (AP) 50–95 measure, respectively. The model performance between the South Korea and Thailand data showed a significant difference, likely because the chimneys in South Korea are very diverse, making it harder to generalize the YOLOv8 model. Furthermore, the model root mean square errors (RMSE) between the imbalanced and balanced data, South Korea and Thailand data, and KOMPSAT-3 and -3A data were about 2.917 and 2.788, 2.690 and 2.951, and 2.913 and 2.580 in chimney height, respectively, and about 1.285 and 1.190, 1.228 and 1.120, and 1.291 and 1.013 in chimney diameter, respectively. Keywords: Chimneys; deep learning; You Only Look Once version 8; Residual Network; Korean Multi-purpose Satellite-3/3A; object detection; regression model.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.