{"title":"Tiny Object Detection in Remote Sensing Images Based on Object Reconstruction and Multiple Receptive Field Adaptive Feature Enhancement","authors":"Dongyang Liu;Junping Zhang;Yunxiao Qi;Yinhu Wu;Ye Zhang","doi":"10.1109/TGRS.2024.3381774","DOIUrl":null,"url":null,"abstract":"Tiny object detection in the field of remote sensing has always been a challenging and interesting topic. Despite many researchers working on this problem, it has not been well-solved due to its complexity. In this article, we analyze the reasons for poor performance of deep-learning-based object detection methods for tiny objects in remote sensing images. Moreover, we propose a new remote sensing image tiny object detection network based on object reconstruction and multiple receptive field adaptive feature enhancement module (MRFAFEM), called ORFENet. Detailedly, object reconstruction aims to reduce the information loss of tiny objects within deep neural networks, which is only used in the training phase and can be discarded in the inference phase. MRFAFEM is designed to enhance the features for detecting tiny objects by dynamically adjusting the multiple receptive field features. We have conducted several experiments on the AI-TODv2 and LEVIR-Ship datasets, both of which are proposed for tiny object detection in remote sensing images. The experimental results indicate the effectiveness of the proposed method. Specifically, the proposed ORFENet can achieve an average precision (AP) of 24.8% on the AI-TODv2 dataset and 83.3% AP50 on the LEVIR-Ship dataset. The code will be released at \n<uri>https://github.com/dyl96/ORFENet</uri>\n.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-13"},"PeriodicalIF":8.6000,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10478927/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Tiny object detection in the field of remote sensing has always been a challenging and interesting topic. Despite many researchers working on this problem, it has not been well-solved due to its complexity. In this article, we analyze the reasons for poor performance of deep-learning-based object detection methods for tiny objects in remote sensing images. Moreover, we propose a new remote sensing image tiny object detection network based on object reconstruction and multiple receptive field adaptive feature enhancement module (MRFAFEM), called ORFENet. Detailedly, object reconstruction aims to reduce the information loss of tiny objects within deep neural networks, which is only used in the training phase and can be discarded in the inference phase. MRFAFEM is designed to enhance the features for detecting tiny objects by dynamically adjusting the multiple receptive field features. We have conducted several experiments on the AI-TODv2 and LEVIR-Ship datasets, both of which are proposed for tiny object detection in remote sensing images. The experimental results indicate the effectiveness of the proposed method. Specifically, the proposed ORFENet can achieve an average precision (AP) of 24.8% on the AI-TODv2 dataset and 83.3% AP50 on the LEVIR-Ship dataset. The code will be released at
https://github.com/dyl96/ORFENet
.
期刊介绍:
IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.