基于频率注意和多感知头的少镜头目标计数

IF 5.5 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Gaoxin Ma , Xingquan Zhu , Zhen Tian , Yangdong Ye , Zhenfeng Zhu
{"title":"基于频率注意和多感知头的少镜头目标计数","authors":"Gaoxin Ma ,&nbsp;Xingquan Zhu ,&nbsp;Zhen Tian ,&nbsp;Yangdong Ye ,&nbsp;Zhenfeng Zhu","doi":"10.1016/j.neucom.2025.130598","DOIUrl":null,"url":null,"abstract":"<div><div>Few-Shot Object Counting (FSC) is a critical technique in computer vision, which focuses on estimating the number of exemplar objects in target tasks. This technique is highly versatile and applicable in diverse domains, such as crowd monitoring, traffic management, and wildlife tracking. The primary challenge in FSC is achieving robust feature matching despite the gap between the diversity of targets and the scarcity of exemplars. In this research, we propose the Few-shot Object Counting Network with Frequency Attention and Multi-Perception Head (FFMP), which aims to enhance the limited examples by identifying additional instances within query images. The FFMP framework comprises three core components: Frequency Domain Feature Fusion (FDF), Self-Adaptive Feature Enhancement (SFE), and Multi-Perception Head (MP). The FDF component fuses features from both spatial and frequency domains to generate more precise similarity maps. The SFE component identifies and focuses on recurrent target features within query images, enriching the initial set of examples and providing a detailed understanding of the target category. Additionally, the MP component integrates counting and detection tasks, thereby improving overall performance. Extensive experiments on the FSC-147 dataset and various class-specific counting datasets demonstrate that FFMP achieves competitive counting performance compared to state-of-the-art methods. Code is available at <span><span>https://github.com/dsl161/FFMP</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"648 ","pages":"Article 130598"},"PeriodicalIF":5.5000,"publicationDate":"2025-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Few-Shot Object Counting with frequency attention and multi-perception head\",\"authors\":\"Gaoxin Ma ,&nbsp;Xingquan Zhu ,&nbsp;Zhen Tian ,&nbsp;Yangdong Ye ,&nbsp;Zhenfeng Zhu\",\"doi\":\"10.1016/j.neucom.2025.130598\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Few-Shot Object Counting (FSC) is a critical technique in computer vision, which focuses on estimating the number of exemplar objects in target tasks. This technique is highly versatile and applicable in diverse domains, such as crowd monitoring, traffic management, and wildlife tracking. The primary challenge in FSC is achieving robust feature matching despite the gap between the diversity of targets and the scarcity of exemplars. In this research, we propose the Few-shot Object Counting Network with Frequency Attention and Multi-Perception Head (FFMP), which aims to enhance the limited examples by identifying additional instances within query images. The FFMP framework comprises three core components: Frequency Domain Feature Fusion (FDF), Self-Adaptive Feature Enhancement (SFE), and Multi-Perception Head (MP). The FDF component fuses features from both spatial and frequency domains to generate more precise similarity maps. The SFE component identifies and focuses on recurrent target features within query images, enriching the initial set of examples and providing a detailed understanding of the target category. Additionally, the MP component integrates counting and detection tasks, thereby improving overall performance. Extensive experiments on the FSC-147 dataset and various class-specific counting datasets demonstrate that FFMP achieves competitive counting performance compared to state-of-the-art methods. Code is available at <span><span>https://github.com/dsl161/FFMP</span><svg><path></path></svg></span>.</div></div>\",\"PeriodicalId\":19268,\"journal\":{\"name\":\"Neurocomputing\",\"volume\":\"648 \",\"pages\":\"Article 130598\"},\"PeriodicalIF\":5.5000,\"publicationDate\":\"2025-06-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neurocomputing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0925231225012706\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231225012706","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

少射目标计数(FSC)是计算机视觉中的一项关键技术,其重点是估计目标任务中样本对象的数量。该技术用途广泛,适用于人群监测、交通管理、野生动物跟踪等领域。尽管目标的多样性和样本的稀缺性之间存在差距,但FSC的主要挑战是实现鲁棒特征匹配。在本研究中,我们提出了带有频率注意和多感知头的少镜头目标计数网络(FFMP),该网络旨在通过识别查询图像中的额外实例来增强有限的示例。FFMP框架包括三个核心组件:频域特征融合(FDF)、自适应特征增强(SFE)和多感知头(MP)。FDF组件融合了空间和频域的特征,以生成更精确的相似性图。SFE组件识别并关注查询图像中反复出现的目标特征,丰富初始示例集,并提供对目标类别的详细理解。此外,MP组件集成了计数和检测任务,从而提高了整体性能。在FSC-147数据集和各种类别特定计数数据集上进行的大量实验表明,与最先进的方法相比,FFMP实现了具有竞争力的计数性能。代码可从https://github.com/dsl161/FFMP获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Few-Shot Object Counting with frequency attention and multi-perception head
Few-Shot Object Counting (FSC) is a critical technique in computer vision, which focuses on estimating the number of exemplar objects in target tasks. This technique is highly versatile and applicable in diverse domains, such as crowd monitoring, traffic management, and wildlife tracking. The primary challenge in FSC is achieving robust feature matching despite the gap between the diversity of targets and the scarcity of exemplars. In this research, we propose the Few-shot Object Counting Network with Frequency Attention and Multi-Perception Head (FFMP), which aims to enhance the limited examples by identifying additional instances within query images. The FFMP framework comprises three core components: Frequency Domain Feature Fusion (FDF), Self-Adaptive Feature Enhancement (SFE), and Multi-Perception Head (MP). The FDF component fuses features from both spatial and frequency domains to generate more precise similarity maps. The SFE component identifies and focuses on recurrent target features within query images, enriching the initial set of examples and providing a detailed understanding of the target category. Additionally, the MP component integrates counting and detection tasks, thereby improving overall performance. Extensive experiments on the FSC-147 dataset and various class-specific counting datasets demonstrate that FFMP achieves competitive counting performance compared to state-of-the-art methods. Code is available at https://github.com/dsl161/FFMP.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Neurocomputing
Neurocomputing 工程技术-计算机:人工智能
CiteScore
13.10
自引率
10.00%
发文量
1382
审稿时长
70 days
期刊介绍: Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信