TSPNet: Temporal-Spatial Pyramid Network for Infrared Maritime Object Detection

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Meng Zhang;Lili Dong;Zhichao Huang;Markus Flierl
{"title":"TSPNet: Temporal-Spatial Pyramid Network for Infrared Maritime Object Detection","authors":"Meng Zhang;Lili Dong;Zhichao Huang;Markus Flierl","doi":"10.1109/JSTARS.2024.3452674","DOIUrl":null,"url":null,"abstract":"Infrared object detection is one of the critical technologies for maritime search and rescue. However, it is still challenging due to the strong background clutter interference and the lack of small object information. We proposed a temporal-spatial pyramid network for infrared maritime object detection. We proposed a nested temporal pyramid to represent the temporal features through motion differences maps and energy accumulation maps to distinguish the wave clutter and objects. We proposed a dense spatial pyramid to learn the spatial features and the differences between temporal maps and then to clarify and locate objects. For training, we designed a scale-related composite loss function with correlated location description and weighted confidence loss. Finally, based on the ablation and comparison experiments, the proposed method performs better on maritime infrared sequences.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":4.7000,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10666102","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10666102/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Infrared object detection is one of the critical technologies for maritime search and rescue. However, it is still challenging due to the strong background clutter interference and the lack of small object information. We proposed a temporal-spatial pyramid network for infrared maritime object detection. We proposed a nested temporal pyramid to represent the temporal features through motion differences maps and energy accumulation maps to distinguish the wave clutter and objects. We proposed a dense spatial pyramid to learn the spatial features and the differences between temporal maps and then to clarify and locate objects. For training, we designed a scale-related composite loss function with correlated location description and weighted confidence loss. Finally, based on the ablation and comparison experiments, the proposed method performs better on maritime infrared sequences.
TSPNet:用于红外海洋物体探测的时空金字塔网络
红外物体探测是海上搜救的关键技术之一。然而,由于背景杂波干扰强、小目标信息缺乏等原因,红外目标检测仍具有挑战性。我们提出了一种用于红外海上物体检测的时空金字塔网络。我们提出了一个嵌套时空金字塔,通过运动差异图和能量累积图来表示时空特征,从而区分波杂波和物体。我们提出了一个密集的空间金字塔来学习空间特征和时间图之间的差异,进而识别和定位物体。在训练中,我们设计了一个与尺度相关的复合损失函数,其中包含相关位置描述和加权置信度损失。最后,基于消融和对比实验,所提出的方法在海事红外序列上有更好的表现。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信