{"title":"基于声纳图像的轻量级水下废物分割深度学习模型","authors":"","doi":"10.1016/j.wasman.2024.09.008","DOIUrl":null,"url":null,"abstract":"<div><p>In recent years, the rapid accumulation of marine waste not only endangers the ecological environment but also causes seawater pollution. Traditional manual salvage methods often have low efficiency and pose safety risks to human operators, making automatic underwater waste recycling a mainstream approach. In this paper, we propose a lightweight multi-scale cross-level network for underwater waste segmentation based on sonar images that provides pixel-level location information and waste categories for autonomous underwater robots. In particular, we introduce hybrid perception and multi-scale attention modules to capture multi-scale contextual features and enhance high-level critical information, respectively. At the same time, we use sampling attention modules and cross-level interaction modules to achieve feature down-sampling and fuse detailed features and semantic features, respectively. Relevant experimental results indicate that our method outperforms other semantic segmentation models and achieves 74.66 % <em>mIoU</em> with only 0.68 M parameters. In particular, compared with the representative PIDNet Small model based on the convolutional neural network architecture, our method can improve the <em>mIoU</em> metric by 1.15 percentage points and can reduce model parameters by approximately 91 %. Compared with the representative SeaFormer T model based on the transformer architecture, our approach can improve the <em>mIoU</em> metric by 2.07 percentage points and can reduce model parameters by approximately 59 %. Our approach maintains a satisfactory balance between model parameters and segmentation performance. Our solution provides new insights into intelligent underwater waste recycling, which helps in promoting sustainable marine development.</p></div>","PeriodicalId":23969,"journal":{"name":"Waste management","volume":null,"pages":null},"PeriodicalIF":7.1000,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Lightweight deep learning model for underwater waste segmentation based on sonar images\",\"authors\":\"\",\"doi\":\"10.1016/j.wasman.2024.09.008\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In recent years, the rapid accumulation of marine waste not only endangers the ecological environment but also causes seawater pollution. Traditional manual salvage methods often have low efficiency and pose safety risks to human operators, making automatic underwater waste recycling a mainstream approach. In this paper, we propose a lightweight multi-scale cross-level network for underwater waste segmentation based on sonar images that provides pixel-level location information and waste categories for autonomous underwater robots. In particular, we introduce hybrid perception and multi-scale attention modules to capture multi-scale contextual features and enhance high-level critical information, respectively. At the same time, we use sampling attention modules and cross-level interaction modules to achieve feature down-sampling and fuse detailed features and semantic features, respectively. Relevant experimental results indicate that our method outperforms other semantic segmentation models and achieves 74.66 % <em>mIoU</em> with only 0.68 M parameters. In particular, compared with the representative PIDNet Small model based on the convolutional neural network architecture, our method can improve the <em>mIoU</em> metric by 1.15 percentage points and can reduce model parameters by approximately 91 %. Compared with the representative SeaFormer T model based on the transformer architecture, our approach can improve the <em>mIoU</em> metric by 2.07 percentage points and can reduce model parameters by approximately 59 %. Our approach maintains a satisfactory balance between model parameters and segmentation performance. Our solution provides new insights into intelligent underwater waste recycling, which helps in promoting sustainable marine development.</p></div>\",\"PeriodicalId\":23969,\"journal\":{\"name\":\"Waste management\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.1000,\"publicationDate\":\"2024-09-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Waste management\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0956053X24004951\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ENVIRONMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Waste management","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0956053X24004951","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ENVIRONMENTAL","Score":null,"Total":0}
引用次数: 0
摘要
近年来,海洋废弃物的快速积累不仅危及生态环境,还会造成海水污染。传统的人工打捞方法往往效率低下,且存在人为操作的安全隐患,因此水下垃圾自动回收成为主流方法。在本文中,我们提出了一种基于声纳图像的轻量级多尺度跨级水下垃圾分割网络,可为自主水下机器人提供像素级的位置信息和垃圾类别。其中,我们引入了混合感知和多尺度注意力模块,分别用于捕捉多尺度上下文特征和增强高层关键信息。同时,我们利用采样注意模块和跨级交互模块分别实现了特征下采样和细节特征与语义特征的融合。相关实验结果表明,我们的方法优于其他语义分割模型,仅用 0.68 M 个参数就实现了 74.66 % 的 mIoU。其中,与代表性的基于卷积神经网络架构的 PIDNet Small 模型相比,我们的方法可将 mIoU 指标提高 1.15 个百分点,并可减少约 91 % 的模型参数。与基于变压器结构的代表性 SeaFormer T 模型相比,我们的方法可将 mIoU 指标提高 2.07 个百分点,并可减少约 59 % 的模型参数。我们的方法在模型参数和分割性能之间保持了令人满意的平衡。我们的解决方案为智能水下废物回收提供了新的见解,有助于促进海洋的可持续发展。
Lightweight deep learning model for underwater waste segmentation based on sonar images
In recent years, the rapid accumulation of marine waste not only endangers the ecological environment but also causes seawater pollution. Traditional manual salvage methods often have low efficiency and pose safety risks to human operators, making automatic underwater waste recycling a mainstream approach. In this paper, we propose a lightweight multi-scale cross-level network for underwater waste segmentation based on sonar images that provides pixel-level location information and waste categories for autonomous underwater robots. In particular, we introduce hybrid perception and multi-scale attention modules to capture multi-scale contextual features and enhance high-level critical information, respectively. At the same time, we use sampling attention modules and cross-level interaction modules to achieve feature down-sampling and fuse detailed features and semantic features, respectively. Relevant experimental results indicate that our method outperforms other semantic segmentation models and achieves 74.66 % mIoU with only 0.68 M parameters. In particular, compared with the representative PIDNet Small model based on the convolutional neural network architecture, our method can improve the mIoU metric by 1.15 percentage points and can reduce model parameters by approximately 91 %. Compared with the representative SeaFormer T model based on the transformer architecture, our approach can improve the mIoU metric by 2.07 percentage points and can reduce model parameters by approximately 59 %. Our approach maintains a satisfactory balance between model parameters and segmentation performance. Our solution provides new insights into intelligent underwater waste recycling, which helps in promoting sustainable marine development.
期刊介绍:
Waste Management is devoted to the presentation and discussion of information on solid wastes,it covers the entire lifecycle of solid. wastes.
Scope:
Addresses solid wastes in both industrialized and economically developing countries
Covers various types of solid wastes, including:
Municipal (e.g., residential, institutional, commercial, light industrial)
Agricultural
Special (e.g., C and D, healthcare, household hazardous wastes, sewage sludge)