基于多尺度ResNeSt-50聚合网络和消息传递的息肉图像分割

Q3 Materials Science
Ping XIA, Guangyi ZHANG, Bangjun LEI, Yaobing ZOU, Tinglong TANG
{"title":"基于多尺度ResNeSt-50聚合网络和消息传递的息肉图像分割","authors":"Ping XIA, Guangyi ZHANG, Bangjun LEI, Yaobing ZOU, Tinglong TANG","doi":"10.37188/ope.20233118.2765","DOIUrl":null,"url":null,"abstract":"é’ˆå¯¹å¤§è‚ çš„æ¯è‚‰ç»„ç»‡ä¸Žæ­£å¸¸ç»„ç»‡é—´æ— æ˜Žæ˜¾è¾¹ç•Œï¼Œå‡†ç¡®å®šä½æ¯è‚‰ä½ç½®å›°éš¾çš„é—®é¢˜ï¼Œæå‡ºäº†ä¸€ç§å¤šå°ºåº¦ResNeSt-50èšåˆç½‘ç»œèžåˆé¡ºåºæ ‘é‡åŠ æƒç½®ä¿¡åº¦ä¼ æ’­ï¼ˆsequential Tree-Reweighted Message Passing, TRW-Sï¼‰çš„æ¯è‚‰å›¾åƒåˆ†å‰²æ–¹æ³•ã€‚ä¸ºæé«˜ç½‘ç»œå¯¹æ¯è‚‰ä¿¡æ¯çš„è¡¨è¾¾èƒ½åŠ›ï¼Œæž„å»ºç¼–ç -è§£ç ç»“æž„çš„å¤šå°ºåº¦ResNeSt-50èšåˆç½‘ç»œï¼Œç¼–ç å™¨ç”±å·ç§¯æ¨¡å—å’Œ4级ResNeSt模块级联构建ResNeSt-50骨干网络,实现跨通道信息间的线性整合与连接;ResNeSt-50é‡‡ç”¨æ‹†åˆ†æ³¨æ„åŠ›æœºåˆ¶åŠ å¼ºé‡è¦é€šé“ç»„çš„è¡¨çŽ°èƒ½åŠ›ï¼Œå¢žå¼ºäº†æ®‹å·®æ¨¡å—æå–æ¯è‚‰å›¾åƒä¿¡æ¯çš„èƒ½åŠ›ï¼›è§£ç éƒ¨åˆ†ä¸‹ä¸‰å±‚æž„å»ºå¤šå±‚æ„Ÿå—é‡Žæ¨¡å—ï¼ˆreceptive field block, RFBï¼‰èŽ·å–å¤šå°ºåº¦ä¿¡æ¯ï¼Œç„¶åŽç”¨å¯†é›†èšåˆæ¨¡å—æ•´åˆå ¶è¾“å‡ºï¼Œå¹¶ä»¥å¿«é€Ÿè§£ç æ–¹å¼è¾“å‡ºè§£ç ä¿¡æ¯ï¼Œä¿è¯å ¶åˆ†å‰²æ€§èƒ½çš„åŒæ—¶å‡å°‘å‚æ•°é‡ï¼›å ¶æ¬¡ï¼Œç”Ÿæˆé¢„æµ‹å›¾æ—¶é‡‡ç”¨æµ‹è¯•æ—¶å›¾åƒå¢žå¼ºï¼ˆTest-Time Augmentation, TTA)模块提升预测准确度,并增强网络的泛化能力;最后,构建基于马尔科夫随机场的TRW-Sç®—æ³•å¯¹è¾“å‡ºçš„é¢„æµ‹å›¾è¿›è¡ŒåŽå¤„ç†ï¼Œä»¥å®žçŽ°åˆ†å‰²è¾¹ç¼˜çš„è¿žç»­æ€§å’Œåˆ†å‰²åŒºåŸŸå† éƒ¨çš„ä¸€è‡´æ€§ã€‚å¯¹å¤§è‚ æ¯è‚‰æ•°æ®é›†Kvasir-SEG的测试结果表明,本文方法相比于U-Net,U-Net++,ResUnet、SFA、PraNet等算法,mDice值达91.6%,mIoUè¾¾86.3%,Smeasureè¾¾0.921, MAE为0.023ï¼Œä¼˜äºŽå ¶ä»–äº”ç§æ¯è‚‰åˆ†å‰²ç®—æ³•ï¼›åœ¨æœªçŸ¥æ•°æ®é›†ETIS-LaribPolypDB,ColonDB上测试结果表明,相比于PraNet模型,本文模型的mDice值分别提升了14.2%,7.7%;从本文模型在ETIS-LaribPolypDBæ•°æ®é›†ä¸Šçš„åˆ†å‰²è¡¨çŽ°çœ‹ï¼Œæœ¬æ–‡ç®—æ³•å¯¹å¾®å°ç— å˜ååˆ†æ•æ„Ÿï¼›å› æ­¤ï¼Œæœ¬æ–‡ç®—æ³•åˆ†å‰²çš„æ¯è‚‰å›¾åƒï¼Œåœ¨åˆ†å‰²åŒºåŸŸå† éƒ¨çš„ä¸€è‡´æ€§ã€åˆ†å‰²è¾¹ç¼˜çš„è¿žç»­æ€§ã€è½®å»“æ¸ æ™°åº¦ã€æ•æ‰å¾®å°ç— å˜èƒ½åŠ›ç­‰æ–¹é¢å‡è¡¨çŽ°å‡ºä¼˜è‰¯çš„æ€§èƒ½ï¼ŒåŒæ—¶ï¼Œå¯¹æœªçŸ¥æ•°æ®é›†å ·æœ‰è¾ƒå¥½çš„æ³›åŒ–èƒ½åŠ›ã€‚","PeriodicalId":39778,"journal":{"name":"Guangxue Jingmi Gongcheng/Optics and Precision Engineering","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Polyp image segmentation based on multi-scale ResNeSt-50 aggregation network and message passing\",\"authors\":\"Ping XIA, Guangyi ZHANG, Bangjun LEI, Yaobing ZOU, Tinglong TANG\",\"doi\":\"10.37188/ope.20233118.2765\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"é’ˆå¯¹å¤§è‚ çš„æ¯è‚‰ç»„ç»‡ä¸Žæ­£å¸¸ç»„ç»‡é—´æ— æ˜Žæ˜¾è¾¹ç•Œï¼Œå‡†ç¡®å®šä½æ¯è‚‰ä½ç½®å›°éš¾çš„é—®é¢˜ï¼Œæå‡ºäº†ä¸€ç§å¤šå°ºåº¦ResNeSt-50èšåˆç½‘ç»œèžåˆé¡ºåºæ ‘é‡åŠ æƒç½®ä¿¡åº¦ä¼ æ’­ï¼ˆsequential Tree-Reweighted Message Passing, TRW-Sï¼‰çš„æ¯è‚‰å›¾åƒåˆ†å‰²æ–¹æ³•ã€‚ä¸ºæé«˜ç½‘ç»œå¯¹æ¯è‚‰ä¿¡æ¯çš„è¡¨è¾¾èƒ½åŠ›ï¼Œæž„å»ºç¼–ç -è§£ç ç»“æž„çš„å¤šå°ºåº¦ResNeSt-50èšåˆç½‘ç»œï¼Œç¼–ç å™¨ç”±å·ç§¯æ¨¡å—å’Œ4级ResNeSt模块级联构建ResNeSt-50骨干网络,实现跨通道信息间的线性整合与连接;ResNeSt-50é‡‡ç”¨æ‹†åˆ†æ³¨æ„åŠ›æœºåˆ¶åŠ å¼ºé‡è¦é€šé“ç»„çš„è¡¨çŽ°èƒ½åŠ›ï¼Œå¢žå¼ºäº†æ®‹å·®æ¨¡å—æå–æ¯è‚‰å›¾åƒä¿¡æ¯çš„èƒ½åŠ›ï¼›è§£ç éƒ¨åˆ†ä¸‹ä¸‰å±‚æž„å»ºå¤šå±‚æ„Ÿå—é‡Žæ¨¡å—ï¼ˆreceptive field block, RFBï¼‰èŽ·å–å¤šå°ºåº¦ä¿¡æ¯ï¼Œç„¶åŽç”¨å¯†é›†èšåˆæ¨¡å—æ•´åˆå ¶è¾“å‡ºï¼Œå¹¶ä»¥å¿«é€Ÿè§£ç æ–¹å¼è¾“å‡ºè§£ç ä¿¡æ¯ï¼Œä¿è¯å ¶åˆ†å‰²æ€§èƒ½çš„åŒæ—¶å‡å°‘å‚æ•°é‡ï¼›å ¶æ¬¡ï¼Œç”Ÿæˆé¢„æµ‹å›¾æ—¶é‡‡ç”¨æµ‹è¯•æ—¶å›¾åƒå¢žå¼ºï¼ˆTest-Time Augmentation, TTA)模块提升预测准确度,并增强网络的泛化能力;最后,构建基于马尔科夫随机场的TRW-Sç®—æ³•å¯¹è¾“å‡ºçš„é¢„æµ‹å›¾è¿›è¡ŒåŽå¤„ç†ï¼Œä»¥å®žçŽ°åˆ†å‰²è¾¹ç¼˜çš„è¿žç»­æ€§å’Œåˆ†å‰²åŒºåŸŸå† éƒ¨çš„ä¸€è‡´æ€§ã€‚å¯¹å¤§è‚ æ¯è‚‰æ•°æ®é›†Kvasir-SEG的测试结果表明,本文方法相比于U-Net,U-Net++,ResUnet、SFA、PraNet等算法,mDice值达91.6%,mIoUè¾¾86.3%,Smeasureè¾¾0.921, MAE为0.023ï¼Œä¼˜äºŽå ¶ä»–äº”ç§æ¯è‚‰åˆ†å‰²ç®—æ³•ï¼›åœ¨æœªçŸ¥æ•°æ®é›†ETIS-LaribPolypDB,ColonDB上测试结果表明,相比于PraNet模型,本文模型的mDice值分别提升了14.2%,7.7%;从本文模型在ETIS-LaribPolypDBæ•°æ®é›†ä¸Šçš„åˆ†å‰²è¡¨çŽ°çœ‹ï¼Œæœ¬æ–‡ç®—æ³•å¯¹å¾®å°ç— å˜ååˆ†æ•æ„Ÿï¼›å› æ­¤ï¼Œæœ¬æ–‡ç®—æ³•åˆ†å‰²çš„æ¯è‚‰å›¾åƒï¼Œåœ¨åˆ†å‰²åŒºåŸŸå† éƒ¨çš„ä¸€è‡´æ€§ã€åˆ†å‰²è¾¹ç¼˜çš„è¿žç»­æ€§ã€è½®å»“æ¸ æ™°åº¦ã€æ•æ‰å¾®å°ç— å˜èƒ½åŠ›ç­‰æ–¹é¢å‡è¡¨çŽ°å‡ºä¼˜è‰¯çš„æ€§èƒ½ï¼ŒåŒæ—¶ï¼Œå¯¹æœªçŸ¥æ•°æ®é›†å ·æœ‰è¾ƒå¥½çš„æ³›åŒ–èƒ½åŠ›ã€‚\",\"PeriodicalId\":39778,\"journal\":{\"name\":\"Guangxue Jingmi Gongcheng/Optics and Precision Engineering\",\"volume\":\"11 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Guangxue Jingmi Gongcheng/Optics and Precision Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.37188/ope.20233118.2765\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"Materials Science\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Guangxue Jingmi Gongcheng/Optics and Precision Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.37188/ope.20233118.2765","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Materials Science","Score":null,"Total":0}
引用次数: 0

摘要

在此基础上,我们开发出了ResNeSt-50ResNeSt-50ResNeSt-50ResNeSt-50 "相序树重加权信息传递"(Tree-Reweighted Message Passing)技术。S: "我想知道","我想知道","我想知道","我想知道","我想知道"。50颗,每颗4.5分,共4颗ResNeSt-50颗。50颗 "感知场阻滞"(receptive field block)。RFB:在人体的感知区域内,形成一个 "感知区块",这个 "感知区块 "就是 "RFB",它的作用是在人体的感知区域内,形成一个 "感知区块"。Time Augmentation(时间扩展):TTA。Sç®æ³å¯¹è¾åºçé¢æµå¾è¿è-å¤ç¼è¿ç" æ§åºå²åºå¯¹ä¸ä¸è æ¯èæ°æ®éKvasir-SEGçæµè¯ç "æ表æ¼æ¬æ¬¹æ¸çæ¯äºU-Netï¼U-Net++ï¼ResUnetãSFAãPraNetç®æ³ï¼mDiceå¼¾¾91.6%,MAE0.023,ETIS-LaribolPolypDB,ColonDB,PraNet,DiceDice14.2%。7%ETIS-LaribPolypDB("LaribPolypDB")炖汤:炖汤的时候加入适量的葱花和姜末,再加入适量的盐和胡椒粉,搅拌均匀即可。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Polyp image segmentation based on multi-scale ResNeSt-50 aggregation network and message passing
é’ˆå¯¹å¤§è‚ çš„æ¯è‚‰ç»„ç»‡ä¸Žæ­£å¸¸ç»„ç»‡é—´æ— æ˜Žæ˜¾è¾¹ç•Œï¼Œå‡†ç¡®å®šä½æ¯è‚‰ä½ç½®å›°éš¾çš„é—®é¢˜ï¼Œæå‡ºäº†ä¸€ç§å¤šå°ºåº¦ResNeSt-50èšåˆç½‘ç»œèžåˆé¡ºåºæ ‘é‡åŠ æƒç½®ä¿¡åº¦ä¼ æ’­ï¼ˆsequential Tree-Reweighted Message Passing, TRW-Sï¼‰çš„æ¯è‚‰å›¾åƒåˆ†å‰²æ–¹æ³•ã€‚ä¸ºæé«˜ç½‘ç»œå¯¹æ¯è‚‰ä¿¡æ¯çš„è¡¨è¾¾èƒ½åŠ›ï¼Œæž„å»ºç¼–ç -è§£ç ç»“æž„çš„å¤šå°ºåº¦ResNeSt-50èšåˆç½‘ç»œï¼Œç¼–ç å™¨ç”±å·ç§¯æ¨¡å—å’Œ4级ResNeSt模块级联构建ResNeSt-50骨干网络,实现跨通道信息间的线性整合与连接;ResNeSt-50é‡‡ç”¨æ‹†åˆ†æ³¨æ„åŠ›æœºåˆ¶åŠ å¼ºé‡è¦é€šé“ç»„çš„è¡¨çŽ°èƒ½åŠ›ï¼Œå¢žå¼ºäº†æ®‹å·®æ¨¡å—æå–æ¯è‚‰å›¾åƒä¿¡æ¯çš„èƒ½åŠ›ï¼›è§£ç éƒ¨åˆ†ä¸‹ä¸‰å±‚æž„å»ºå¤šå±‚æ„Ÿå—é‡Žæ¨¡å—ï¼ˆreceptive field block, RFBï¼‰èŽ·å–å¤šå°ºåº¦ä¿¡æ¯ï¼Œç„¶åŽç”¨å¯†é›†èšåˆæ¨¡å—æ•´åˆå ¶è¾“å‡ºï¼Œå¹¶ä»¥å¿«é€Ÿè§£ç æ–¹å¼è¾“å‡ºè§£ç ä¿¡æ¯ï¼Œä¿è¯å ¶åˆ†å‰²æ€§èƒ½çš„åŒæ—¶å‡å°‘å‚æ•°é‡ï¼›å ¶æ¬¡ï¼Œç”Ÿæˆé¢„æµ‹å›¾æ—¶é‡‡ç”¨æµ‹è¯•æ—¶å›¾åƒå¢žå¼ºï¼ˆTest-Time Augmentation, TTA)模块提升预测准确度,并增强网络的泛化能力;最后,构建基于马尔科夫随机场的TRW-Sç®—æ³•å¯¹è¾“å‡ºçš„é¢„æµ‹å›¾è¿›è¡ŒåŽå¤„ç†ï¼Œä»¥å®žçŽ°åˆ†å‰²è¾¹ç¼˜çš„è¿žç»­æ€§å’Œåˆ†å‰²åŒºåŸŸå† éƒ¨çš„ä¸€è‡´æ€§ã€‚å¯¹å¤§è‚ æ¯è‚‰æ•°æ®é›†Kvasir-SEG的测试结果表明,本文方法相比于U-Net,U-Net++,ResUnet、SFA、PraNet等算法,mDice值达91.6%,mIoUè¾¾86.3%,Smeasureè¾¾0.921, MAE为0.023ï¼Œä¼˜äºŽå ¶ä»–äº”ç§æ¯è‚‰åˆ†å‰²ç®—æ³•ï¼›åœ¨æœªçŸ¥æ•°æ®é›†ETIS-LaribPolypDB,ColonDB上测试结果表明,相比于PraNet模型,本文模型的mDice值分别提升了14.2%,7.7%;从本文模型在ETIS-LaribPolypDBæ•°æ®é›†ä¸Šçš„åˆ†å‰²è¡¨çŽ°çœ‹ï¼Œæœ¬æ–‡ç®—æ³•å¯¹å¾®å°ç— å˜ååˆ†æ•æ„Ÿï¼›å› æ­¤ï¼Œæœ¬æ–‡ç®—æ³•åˆ†å‰²çš„æ¯è‚‰å›¾åƒï¼Œåœ¨åˆ†å‰²åŒºåŸŸå† éƒ¨çš„ä¸€è‡´æ€§ã€åˆ†å‰²è¾¹ç¼˜çš„è¿žç»­æ€§ã€è½®å»“æ¸ æ™°åº¦ã€æ•æ‰å¾®å°ç— å˜èƒ½åŠ›ç­‰æ–¹é¢å‡è¡¨çŽ°å‡ºä¼˜è‰¯çš„æ€§èƒ½ï¼ŒåŒæ—¶ï¼Œå¯¹æœªçŸ¥æ•°æ®é›†å ·æœ‰è¾ƒå¥½çš„æ³›åŒ–èƒ½åŠ›ã€‚
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Guangxue Jingmi Gongcheng/Optics and Precision Engineering
Guangxue Jingmi Gongcheng/Optics and Precision Engineering Materials Science-Electronic, Optical and Magnetic Materials
CiteScore
2.40
自引率
0.00%
发文量
95
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信