基于丰富原型生成和循环预测增强的少镜头分割

Hongsheng Wang, Xiaoqi Zhao, Youwei Pang, Jinqing Qi
{"title":"基于丰富原型生成和循环预测增强的少镜头分割","authors":"Hongsheng Wang, Xiaoqi Zhao, Youwei Pang, Jinqing Qi","doi":"10.48550/arXiv.2210.00765","DOIUrl":null,"url":null,"abstract":". Prototype learning and decoder construction are the keys for few-shot segmentation. However, existing methods use only a single prototype generation mode, which can not cope with the intractable problem of objects with various scales. Moreover, the one-way forward propagation adopted by previous methods may cause information dilution from registered features during the decoding process. In this research, we propose a rich prototype generation module (RPGM) and a recurrent prediction enhancement module (RPEM) to reinforce the prototype learning paradigm and build a unified memory-augmented decoder for few-shot segmentation, respectively. Specifically, the RPGM combines superpixel and K-means clustering to generate rich prototype features with complementary scale relationships and adapt the scale gap between support and query images. The RPEM utilizes the recurrent mechanism to design a round-way propagation decoder. In this way, registered features can provide object-aware information continuously. Experiments show that our method consistently outperforms other competitors on two popular benchmarks PASCAL-5 i and COCO-20 i . role in few-shot segmentation. The prototype represents only object-related features and does not contain","PeriodicalId":420492,"journal":{"name":"Chinese Conference on Pattern Recognition and Computer Vision","volume":"28 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Few-Shot Segmentation via Rich Prototype Generation and Recurrent Prediction Enhancement\",\"authors\":\"Hongsheng Wang, Xiaoqi Zhao, Youwei Pang, Jinqing Qi\",\"doi\":\"10.48550/arXiv.2210.00765\",\"DOIUrl\":null,\"url\":null,\"abstract\":\". Prototype learning and decoder construction are the keys for few-shot segmentation. However, existing methods use only a single prototype generation mode, which can not cope with the intractable problem of objects with various scales. Moreover, the one-way forward propagation adopted by previous methods may cause information dilution from registered features during the decoding process. In this research, we propose a rich prototype generation module (RPGM) and a recurrent prediction enhancement module (RPEM) to reinforce the prototype learning paradigm and build a unified memory-augmented decoder for few-shot segmentation, respectively. Specifically, the RPGM combines superpixel and K-means clustering to generate rich prototype features with complementary scale relationships and adapt the scale gap between support and query images. The RPEM utilizes the recurrent mechanism to design a round-way propagation decoder. In this way, registered features can provide object-aware information continuously. Experiments show that our method consistently outperforms other competitors on two popular benchmarks PASCAL-5 i and COCO-20 i . role in few-shot segmentation. The prototype represents only object-related features and does not contain\",\"PeriodicalId\":420492,\"journal\":{\"name\":\"Chinese Conference on Pattern Recognition and Computer Vision\",\"volume\":\"28 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Chinese Conference on Pattern Recognition and Computer Vision\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.48550/arXiv.2210.00765\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chinese Conference on Pattern Recognition and Computer Vision","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.48550/arXiv.2210.00765","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

. 原型学习和解码器构建是实现少镜头分割的关键。然而,现有方法仅采用单一的原型生成模式,无法处理各种尺度对象的棘手问题。此外,以前的方法采用单向前向传播,在解码过程中可能会造成配准特征的信息稀释。在这项研究中,我们提出了一个丰富的原型生成模块(RPGM)和一个循环预测增强模块(RPEM)来加强原型学习范式,并建立了一个统一的记忆增强解码器来进行少镜头分割。具体来说,RPGM将超像素和K-means聚类相结合,生成具有互补尺度关系的丰富原型特征,并适应支持图像和查询图像之间的尺度差距。RPEM利用循环机制设计了一个双向传播解码器。通过这种方式,注册的特征可以持续地提供对象感知信息。实验表明,我们的方法在两个流行的基准PASCAL-5 i和COCO-20 i上始终优于其他竞争对手。在少数镜头分割的作用。原型只表示与对象相关的特性,不包含
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Few-Shot Segmentation via Rich Prototype Generation and Recurrent Prediction Enhancement
. Prototype learning and decoder construction are the keys for few-shot segmentation. However, existing methods use only a single prototype generation mode, which can not cope with the intractable problem of objects with various scales. Moreover, the one-way forward propagation adopted by previous methods may cause information dilution from registered features during the decoding process. In this research, we propose a rich prototype generation module (RPGM) and a recurrent prediction enhancement module (RPEM) to reinforce the prototype learning paradigm and build a unified memory-augmented decoder for few-shot segmentation, respectively. Specifically, the RPGM combines superpixel and K-means clustering to generate rich prototype features with complementary scale relationships and adapt the scale gap between support and query images. The RPEM utilizes the recurrent mechanism to design a round-way propagation decoder. In this way, registered features can provide object-aware information continuously. Experiments show that our method consistently outperforms other competitors on two popular benchmarks PASCAL-5 i and COCO-20 i . role in few-shot segmentation. The prototype represents only object-related features and does not contain
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信