A Novel Behavior Detection Method for Sows and Piglets during Lactation Based on an Inspection Robot

IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY
Jie Zhou , Luo Liu , Tao Jiang , Haonan Tian , Mingxia Shen , Longshen Liu
{"title":"A Novel Behavior Detection Method for Sows and Piglets during Lactation Based on an Inspection Robot","authors":"Jie Zhou ,&nbsp;Luo Liu ,&nbsp;Tao Jiang ,&nbsp;Haonan Tian ,&nbsp;Mingxia Shen ,&nbsp;Longshen Liu","doi":"10.1016/j.compag.2024.109613","DOIUrl":null,"url":null,"abstract":"<div><div>Accurately identifying behaviors exhibited by lactating sows and piglets is crucial for maintaining swine health and preventing farming crises. In the absence of dedicated swine behavior monitoring systems and the challenges of implementing cloud-based automated monitoring in large-scale farming, this study proposes a method utilizing inspection robots to detect behaviors of lactating sows and piglets. The inspection robot initially serves as a data acquisition and storage tool, collecting behavioral data such as sows postures (standing, sitting, lateral recumbency, and sternal recumbency) and activities of piglet groups (resting, suckling, and active behavior) within confined pens. The YOLOv8 series algorithms are then employed to identify static postures of sows, while the Temporal Shift Module (TSM) is used to recognize dynamic behaviors within piglet groups. These models are fine-tuned and deployed on the Jetson Nano edge computing platform. Experimental results show that YOLOv8n accurately identifies sow postures with a mean Average Precision (mAP) @0.5 of 97.08% and a frame rate of 36.4 FPS at an image resolution of 480 × 288, following TensorRT acceleration. For piglet behavior recognition, the TSM model, using ResNet50 as the backbone network, achieves a Top-1 accuracy of 93.63% in recognizing piglet behaviors. Replacing ResNet50 with MobileNetv2 slightly reduces the Top-1 accuracy to 90.81%; however, there is a significant improvement in inference speed on Jetson Nano for a single video clip with a processing duration of 542.51 ms, representing more than a 20-fold enhancement compared to TSM_ResNet50. The Kappa consistency analysis reveals moderate behavioral coherence among sows in different pens and piglet groups. The study offers insights into automated detection of behaviors lactating sows and piglets within large-scale intensive farming systems.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"227 ","pages":"Article 109613"},"PeriodicalIF":7.7000,"publicationDate":"2024-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169924010044","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Accurately identifying behaviors exhibited by lactating sows and piglets is crucial for maintaining swine health and preventing farming crises. In the absence of dedicated swine behavior monitoring systems and the challenges of implementing cloud-based automated monitoring in large-scale farming, this study proposes a method utilizing inspection robots to detect behaviors of lactating sows and piglets. The inspection robot initially serves as a data acquisition and storage tool, collecting behavioral data such as sows postures (standing, sitting, lateral recumbency, and sternal recumbency) and activities of piglet groups (resting, suckling, and active behavior) within confined pens. The YOLOv8 series algorithms are then employed to identify static postures of sows, while the Temporal Shift Module (TSM) is used to recognize dynamic behaviors within piglet groups. These models are fine-tuned and deployed on the Jetson Nano edge computing platform. Experimental results show that YOLOv8n accurately identifies sow postures with a mean Average Precision (mAP) @0.5 of 97.08% and a frame rate of 36.4 FPS at an image resolution of 480 × 288, following TensorRT acceleration. For piglet behavior recognition, the TSM model, using ResNet50 as the backbone network, achieves a Top-1 accuracy of 93.63% in recognizing piglet behaviors. Replacing ResNet50 with MobileNetv2 slightly reduces the Top-1 accuracy to 90.81%; however, there is a significant improvement in inference speed on Jetson Nano for a single video clip with a processing duration of 542.51 ms, representing more than a 20-fold enhancement compared to TSM_ResNet50. The Kappa consistency analysis reveals moderate behavioral coherence among sows in different pens and piglet groups. The study offers insights into automated detection of behaviors lactating sows and piglets within large-scale intensive farming systems.
基于检测机器人的哺乳期母猪和仔猪行为检测新方法
准确识别哺乳母猪和仔猪的行为对维护猪群健康和预防养殖危机至关重要。由于缺乏专用的猪群行为监测系统,且在大规模养殖中实施基于云的自动监测存在挑战,本研究提出了一种利用检测机器人检测哺乳母猪和仔猪行为的方法。检测机器人最初作为数据采集和存储工具,收集行为数据,如母猪在密闭猪圈内的姿势(站立、坐立、侧卧、胸卧)和仔猪群体的活动(休息、吸吮和活动行为)。然后,利用 YOLOv8 系列算法识别母猪的静态姿势,同时利用时移模块 (TSM) 识别仔猪群的动态行为。这些模型经过微调后部署在 Jetson Nano 边缘计算平台上。实验结果表明,YOLOv8n 能准确识别母猪姿态,平均精度 (mAP) @0.5 为 97.08%,在图像分辨率为 480 × 288 的情况下,经过 TensorRT 加速后的帧速率为 36.4 FPS。在仔猪行为识别方面,使用 ResNet50 作为骨干网络的 TSM 模型在识别仔猪行为方面达到了 93.63% 的 Top-1 准确率。用 MobileNetv2 代替 ResNet50 后,Top-1 准确率略有下降,为 90.81%;但是,在 Jetson Nano 上对处理时长为 542.51 毫秒的单个视频片段的推理速度有了显著提高,与 TSM_ResNet50 相比提高了 20 倍以上。Kappa 一致性分析表明,不同猪栏和仔猪组的母猪行为具有适度的一致性。这项研究为在大规模集约化养殖系统中自动检测哺乳母猪和仔猪的行为提供了启示。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computers and Electronics in Agriculture
Computers and Electronics in Agriculture 工程技术-计算机:跨学科应用
CiteScore
15.30
自引率
14.50%
发文量
800
审稿时长
62 days
期刊介绍: Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信