iFBI:猫和狗的轻量级品种和个体识别

IF 5.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Yuanze Zhang;Yimeng Zhang;Kexu Li;Jinpeng Luo;Gang Liu;Rong Pan
{"title":"iFBI:猫和狗的轻量级品种和个体识别","authors":"Yuanze Zhang;Yimeng Zhang;Kexu Li;Jinpeng Luo;Gang Liu;Rong Pan","doi":"10.1109/TIM.2025.3576017","DOIUrl":null,"url":null,"abstract":"As the pet industry develops, fine-grained breed recognition and individual recognition have emerged as essential components in biometric measurement systems for intelligent pet monitoring, aiming to identify the specific breed of a pet in an image and to recognize the same individual across multiple images. These capabilities lay the foundation for downstream tasks such as posture estimation and emotion analysis, supporting a wide range of real-world applications. Despite the substantial advancements achieved in existing research, two critical issues remain to be solved: the diversity of object poses affects representation in complex scenarios, and the conflict between model complexity and performance hinders application in resource-constrained conditions. To address the above issues, we propose integrated face and body information (iFBI) for a lightweight breed and individual recognition scheme that integrates multiple pose information by a lightweight model. Specifically, a face alignment (FA) module and a body posture-guided (BPG) module are proposed to separate face and body information from the input images, fully capturing the posture details while suppressing background areas. To further maximize the discrimination between individual samples, we design a multilevel representation recognition (MRR) module that dynamically integrates complementary semantic features of face and body, consequently generating more discriminative features. In addition, a dynamic convolutional model compression (DCMC) method is implemented with an improved dual-branch backbone that significantly reduces computational costs while enhancing model performance. Extensive experiments on two self-built datasets—pet with fine-grained breed (Pet-FB) dataset and pet with diverse posture (Pet-DP) dataset—and four public datasets indicate that iFBI yields superior performance in both fine-grained breed recognition and individual recognition tasks. The source code and self-built datasets—Pet-FB and Pet-DP—are available at our GitHub repository.","PeriodicalId":13341,"journal":{"name":"IEEE Transactions on Instrumentation and Measurement","volume":"74 ","pages":"1-15"},"PeriodicalIF":5.6000,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"iFBI: Lightweight Breed and Individual Recognition for Cats and Dogs\",\"authors\":\"Yuanze Zhang;Yimeng Zhang;Kexu Li;Jinpeng Luo;Gang Liu;Rong Pan\",\"doi\":\"10.1109/TIM.2025.3576017\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"As the pet industry develops, fine-grained breed recognition and individual recognition have emerged as essential components in biometric measurement systems for intelligent pet monitoring, aiming to identify the specific breed of a pet in an image and to recognize the same individual across multiple images. These capabilities lay the foundation for downstream tasks such as posture estimation and emotion analysis, supporting a wide range of real-world applications. Despite the substantial advancements achieved in existing research, two critical issues remain to be solved: the diversity of object poses affects representation in complex scenarios, and the conflict between model complexity and performance hinders application in resource-constrained conditions. To address the above issues, we propose integrated face and body information (iFBI) for a lightweight breed and individual recognition scheme that integrates multiple pose information by a lightweight model. Specifically, a face alignment (FA) module and a body posture-guided (BPG) module are proposed to separate face and body information from the input images, fully capturing the posture details while suppressing background areas. To further maximize the discrimination between individual samples, we design a multilevel representation recognition (MRR) module that dynamically integrates complementary semantic features of face and body, consequently generating more discriminative features. In addition, a dynamic convolutional model compression (DCMC) method is implemented with an improved dual-branch backbone that significantly reduces computational costs while enhancing model performance. Extensive experiments on two self-built datasets—pet with fine-grained breed (Pet-FB) dataset and pet with diverse posture (Pet-DP) dataset—and four public datasets indicate that iFBI yields superior performance in both fine-grained breed recognition and individual recognition tasks. The source code and self-built datasets—Pet-FB and Pet-DP—are available at our GitHub repository.\",\"PeriodicalId\":13341,\"journal\":{\"name\":\"IEEE Transactions on Instrumentation and Measurement\",\"volume\":\"74 \",\"pages\":\"1-15\"},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2025-06-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Instrumentation and Measurement\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11021558/\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Instrumentation and Measurement","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/11021558/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

随着宠物行业的发展,细粒度的品种识别和个体识别已经成为智能宠物监控生物特征测量系统的重要组成部分,旨在识别图像中宠物的特定品种,并在多个图像中识别同一个体。这些功能为姿态估计和情绪分析等下游任务奠定了基础,支持广泛的现实应用。尽管现有研究取得了实质性进展,但仍有两个关键问题有待解决:复杂场景下对象姿态的多样性影响表征,以及模型复杂性和性能之间的冲突阻碍了资源约束条件下的应用。为了解决上述问题,我们提出了一种轻量级品种的集成面部和身体信息(iFBI)以及通过轻量级模型集成多个姿态信息的个体识别方案。具体来说,提出了人脸对齐(FA)模块和身体姿势引导(BPG)模块,将人脸和身体信息从输入图像中分离出来,充分捕捉姿势细节,同时抑制背景区域。为了进一步最大化个体样本之间的区别,我们设计了一个多级表示识别(MRR)模块,该模块动态集成了人脸和身体的互补语义特征,从而产生更多的区别特征。此外,采用改进的双分支主干实现了一种动态卷积模型压缩(DCMC)方法,大大降低了计算成本,同时提高了模型性能。在两个自建数据集——细粒度品种宠物(pet - fb)数据集和不同姿势宠物(pet - dp)数据集——以及四个公共数据集上进行的大量实验表明,iFBI在细粒度品种识别和个体识别任务中都具有优异的性能。源代码和自建的数据集- pet - fb和pet - dp -可以在我们的GitHub存储库中获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
iFBI: Lightweight Breed and Individual Recognition for Cats and Dogs
As the pet industry develops, fine-grained breed recognition and individual recognition have emerged as essential components in biometric measurement systems for intelligent pet monitoring, aiming to identify the specific breed of a pet in an image and to recognize the same individual across multiple images. These capabilities lay the foundation for downstream tasks such as posture estimation and emotion analysis, supporting a wide range of real-world applications. Despite the substantial advancements achieved in existing research, two critical issues remain to be solved: the diversity of object poses affects representation in complex scenarios, and the conflict between model complexity and performance hinders application in resource-constrained conditions. To address the above issues, we propose integrated face and body information (iFBI) for a lightweight breed and individual recognition scheme that integrates multiple pose information by a lightweight model. Specifically, a face alignment (FA) module and a body posture-guided (BPG) module are proposed to separate face and body information from the input images, fully capturing the posture details while suppressing background areas. To further maximize the discrimination between individual samples, we design a multilevel representation recognition (MRR) module that dynamically integrates complementary semantic features of face and body, consequently generating more discriminative features. In addition, a dynamic convolutional model compression (DCMC) method is implemented with an improved dual-branch backbone that significantly reduces computational costs while enhancing model performance. Extensive experiments on two self-built datasets—pet with fine-grained breed (Pet-FB) dataset and pet with diverse posture (Pet-DP) dataset—and four public datasets indicate that iFBI yields superior performance in both fine-grained breed recognition and individual recognition tasks. The source code and self-built datasets—Pet-FB and Pet-DP—are available at our GitHub repository.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Instrumentation and Measurement
IEEE Transactions on Instrumentation and Measurement 工程技术-工程:电子与电气
CiteScore
9.00
自引率
23.20%
发文量
1294
审稿时长
3.9 months
期刊介绍: Papers are sought that address innovative solutions to the development and use of electrical and electronic instruments and equipment to measure, monitor and/or record physical phenomena for the purpose of advancing measurement science, methods, functionality and applications. The scope of these papers may encompass: (1) theory, methodology, and practice of measurement; (2) design, development and evaluation of instrumentation and measurement systems and components used in generating, acquiring, conditioning and processing signals; (3) analysis, representation, display, and preservation of the information obtained from a set of measurements; and (4) scientific and technical support to establishment and maintenance of technical standards in the field of Instrumentation and Measurement.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信