PAB-Mamba-YOLO: VSSM assists in YOLO for aggressive behavior detection among weaned piglets

IF 8.2 Q1 AGRICULTURE, MULTIDISCIPLINARY
Xue Xia , Ning Zhang , Zhibin Guan , Xin Chai , Shixin Ma , Xiujuan Chai , Tan Sun
{"title":"PAB-Mamba-YOLO: VSSM assists in YOLO for aggressive behavior detection among weaned piglets","authors":"Xue Xia ,&nbsp;Ning Zhang ,&nbsp;Zhibin Guan ,&nbsp;Xin Chai ,&nbsp;Shixin Ma ,&nbsp;Xiujuan Chai ,&nbsp;Tan Sun","doi":"10.1016/j.aiia.2025.01.001","DOIUrl":null,"url":null,"abstract":"<div><div>Aggressive behavior among piglets is considered a harmful social contact. Monitoring weaned piglets with intense aggressive behaviors is paramount for pig breeding management. This study introduced a novel hybrid model, PAB-Mamba-YOLO, integrating the principles of Mamba and YOLO for efficient visual detection of weaned piglets' aggressive behaviors, including climbing body, nose hitting, biting tail and biting ear. Within the proposed model, a novel CSPVSS module, which integrated the Cross Stage Partial (CSP) structure with the Visual State Space Model (VSSM), has been developed. This module was adeptly integrated into the Neck part of the network, where it harnessed convolutional capabilities for local feature extraction and leveraged the visual state space to reveal long-distance dependencies. The model exhibited sound performance in detecting aggressive behaviors, with an average precision (AP) of 0.976 for climbing body, 0.994 for nose hitting, 0.977 for biting tail and 0.994 for biting ear. The mean average precision (mAP) of 0.985 reflected the model's overall effectiveness in detecting all classes of aggressive behaviors. The model achieved a detection speed FPS of 69 f/s, with model complexity measured by 7.2 G floating-point operations (GFLOPs) and parameters (Params) of 2.63 million. Comparative experiments with existing prevailing models confirmed the superiority of the proposed model. This work is expected to contribute a glimmer of fresh ideas and inspiration to the research field of precision breeding and behavioral analysis of animals.</div></div>","PeriodicalId":52814,"journal":{"name":"Artificial Intelligence in Agriculture","volume":"15 1","pages":"Pages 52-66"},"PeriodicalIF":8.2000,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial Intelligence in Agriculture","FirstCategoryId":"1087","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2589721725000017","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Aggressive behavior among piglets is considered a harmful social contact. Monitoring weaned piglets with intense aggressive behaviors is paramount for pig breeding management. This study introduced a novel hybrid model, PAB-Mamba-YOLO, integrating the principles of Mamba and YOLO for efficient visual detection of weaned piglets' aggressive behaviors, including climbing body, nose hitting, biting tail and biting ear. Within the proposed model, a novel CSPVSS module, which integrated the Cross Stage Partial (CSP) structure with the Visual State Space Model (VSSM), has been developed. This module was adeptly integrated into the Neck part of the network, where it harnessed convolutional capabilities for local feature extraction and leveraged the visual state space to reveal long-distance dependencies. The model exhibited sound performance in detecting aggressive behaviors, with an average precision (AP) of 0.976 for climbing body, 0.994 for nose hitting, 0.977 for biting tail and 0.994 for biting ear. The mean average precision (mAP) of 0.985 reflected the model's overall effectiveness in detecting all classes of aggressive behaviors. The model achieved a detection speed FPS of 69 f/s, with model complexity measured by 7.2 G floating-point operations (GFLOPs) and parameters (Params) of 2.63 million. Comparative experiments with existing prevailing models confirmed the superiority of the proposed model. This work is expected to contribute a glimmer of fresh ideas and inspiration to the research field of precision breeding and behavioral analysis of animals.
bab - mamba -YOLO: VSSM协助YOLO在断奶仔猪的攻击行为检测
小猪之间的攻击性行为被认为是一种有害的社会接触。监测具有强烈攻击行为的断奶仔猪对猪的育种管理至关重要。本研究结合曼巴和YOLO的原理,建立了一种新的杂交模型,即PAB-Mamba-YOLO,用于对断奶仔猪爬身、撞鼻、咬尾、咬耳等攻击行为进行高效的视觉检测。在提出的模型中,开发了一种新的CSPVSS模块,该模块将跨阶段部分(CSP)结构与视觉状态空间模型(VSSM)相结合。该模块被巧妙地集成到网络的颈部部分,在那里它利用卷积功能进行局部特征提取,并利用视觉状态空间来显示远程依赖关系。该模型检测攻击行为的平均精度(AP)分别为0.976、0.994、0.977和0.994。平均平均精度(mAP)为0.985,反映了该模型在检测各类攻击行为方面的总体有效性。该模型的检测速度FPS为69 f/s,通过7.2 G浮点运算(GFLOPs)和参数(Params)测量模型复杂度为263万。与现有主流模型的对比实验证实了所提模型的优越性。该工作有望为动物精密育种和行为分析研究领域提供一丝新的思路和灵感。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Artificial Intelligence in Agriculture
Artificial Intelligence in Agriculture Engineering-Engineering (miscellaneous)
CiteScore
21.60
自引率
0.00%
发文量
18
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信