{"title":"UVTD: A Large-Scale Multilabel Data Set for Underwater Vision Tasks","authors":"Zhengyong Wang;Meng Yu;Lei Cao;Pengyu Liu;Linfeng Wang;Xiang Li;Yixiao Hong;Chang He;Liquan Shen","doi":"10.1109/JOE.2024.3503664","DOIUrl":null,"url":null,"abstract":"With the exploration of ocean resources, underwater vision tasks (UVTs) have attracted increasing interest in recent years. However, the advancement of UVTs is hampered by several challenges, prominently the difficulty in acquiring large-scale data sets with accurate annotations, and the absence of a unified multi-label data set for underwater multitask learning (UMTL). Motivated by the critical need for a large-scale, multilabel data set tailored for UVTs, we present a large-scale multilabel data set for underwater vision tasks (UVTD), which offers solutions to several bottlenecks in UVT research: first, supporting diverse applications. With annotations for two underwater low-level vision tasks (i.e., underwater image enhancement and underwater image quality assessment) and three high-level vision tasks (i.e., underwater semantic segmentation, underwater object detection, and underwater salient object detection), UVTD supports a wide range of underwater applications. Second, enhancing model generalization. UVTD comprises 5380 real underwater images, covering diverse scenes and varied degradation characteristics, improving the robustness of vision algorithms. Finally, facilitating multitask learning. Our multilabel data set enables researchers to explore the correlations between tasks and develop robust UMTL algorithms. Based on UVTD, we propose two UMTL networks tailored to the low-level and high-level tasks separately, serving as benchmarks for future research in the UMTL field. Extensive experiments demonstrate UVTD's superiority across multiple UVTs, and the proposed UMTL networks exhibit competitive performance on these tasks, implying the significant implications of UVTD for future research.","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"50 2","pages":"898-918"},"PeriodicalIF":3.8000,"publicationDate":"2025-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Oceanic Engineering","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10850640/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0
Abstract
With the exploration of ocean resources, underwater vision tasks (UVTs) have attracted increasing interest in recent years. However, the advancement of UVTs is hampered by several challenges, prominently the difficulty in acquiring large-scale data sets with accurate annotations, and the absence of a unified multi-label data set for underwater multitask learning (UMTL). Motivated by the critical need for a large-scale, multilabel data set tailored for UVTs, we present a large-scale multilabel data set for underwater vision tasks (UVTD), which offers solutions to several bottlenecks in UVT research: first, supporting diverse applications. With annotations for two underwater low-level vision tasks (i.e., underwater image enhancement and underwater image quality assessment) and three high-level vision tasks (i.e., underwater semantic segmentation, underwater object detection, and underwater salient object detection), UVTD supports a wide range of underwater applications. Second, enhancing model generalization. UVTD comprises 5380 real underwater images, covering diverse scenes and varied degradation characteristics, improving the robustness of vision algorithms. Finally, facilitating multitask learning. Our multilabel data set enables researchers to explore the correlations between tasks and develop robust UMTL algorithms. Based on UVTD, we propose two UMTL networks tailored to the low-level and high-level tasks separately, serving as benchmarks for future research in the UMTL field. Extensive experiments demonstrate UVTD's superiority across multiple UVTs, and the proposed UMTL networks exhibit competitive performance on these tasks, implying the significant implications of UVTD for future research.
期刊介绍:
The IEEE Journal of Oceanic Engineering (ISSN 0364-9059) is the online-only quarterly publication of the IEEE Oceanic Engineering Society (IEEE OES). The scope of the Journal is the field of interest of the IEEE OES, which encompasses all aspects of science, engineering, and technology that address research, development, and operations pertaining to all bodies of water. This includes the creation of new capabilities and technologies from concept design through prototypes, testing, and operational systems to sense, explore, understand, develop, use, and responsibly manage natural resources.