Junpeng Zhang , Zihan Bai , Yifan Wei , Jinglei Tang , Ruizi Han , Jiaying Jiang
{"title":"基于 YOLO11 和 ELSlowFast-LSTM 的奶山羊行为检测","authors":"Junpeng Zhang , Zihan Bai , Yifan Wei , Jinglei Tang , Ruizi Han , Jiaying Jiang","doi":"10.1016/j.compag.2025.110224","DOIUrl":null,"url":null,"abstract":"<div><div>Monitoring dairy goat behavior can effectively assess their health status and welfare levels, ensuring both the yield and quality of goat milk. However, achieving accurate and rapid detection of dairy goat behaviors remains challenging. This study proposes a dairy goat behavior detection method based on YOLO11 and ELSlowFast-LSTM (3D-ELA-SlowFast-LSTM) to locate dairy goats and recognize five behaviors: standing, walking, lying down, climbing, and fighting. Firstly, the YOLO11 object detection module is used to pinpoint the locations of dairy goats. Next, the ELSlowFast-LSTM behavior recognition module is introduced to classify behaviors within the detected regions. This module utilizes the SlowFast network for spatiotemporal feature extraction, incorporating the 3D-Efficient Local (EL) attention mechanism specifically designed to enhance the extraction of behavior-related features. Additionally, the Long Short-Term Memory (LSTM) module is applied to model temporal sequence features. Finally, by combining the results of the two modules, the task of dairy goat behavior detection is accomplished. To evaluate the proposed method, we constructed the DairyGoat dataset. Experimental results show that our method achieved a <span><math><mrow><mi>m</mi><mi>A</mi><mi>P</mi></mrow></math></span> value of 78.70%. Additionally, we compared the <span><math><mrow><mi>m</mi><mi>A</mi><mi>P</mi></mrow></math></span> value of our proposed method with other behavior detection models, and the results demonstrate that our method achieves the best detection performance while maintaining a relatively low parameter count and computational load. In summary, this is an effective dairy goat behavior detection method that provides a new strategy for intelligent farming. The dataset and code are available at <span><span>https://github.com/JunpengZZhang/ELSlowFast-LSTM</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":"234 ","pages":"Article 110224"},"PeriodicalIF":8.9000,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Behavior detection of dairy goat based on YOLO11 and ELSlowFast-LSTM\",\"authors\":\"Junpeng Zhang , Zihan Bai , Yifan Wei , Jinglei Tang , Ruizi Han , Jiaying Jiang\",\"doi\":\"10.1016/j.compag.2025.110224\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Monitoring dairy goat behavior can effectively assess their health status and welfare levels, ensuring both the yield and quality of goat milk. However, achieving accurate and rapid detection of dairy goat behaviors remains challenging. This study proposes a dairy goat behavior detection method based on YOLO11 and ELSlowFast-LSTM (3D-ELA-SlowFast-LSTM) to locate dairy goats and recognize five behaviors: standing, walking, lying down, climbing, and fighting. Firstly, the YOLO11 object detection module is used to pinpoint the locations of dairy goats. Next, the ELSlowFast-LSTM behavior recognition module is introduced to classify behaviors within the detected regions. This module utilizes the SlowFast network for spatiotemporal feature extraction, incorporating the 3D-Efficient Local (EL) attention mechanism specifically designed to enhance the extraction of behavior-related features. Additionally, the Long Short-Term Memory (LSTM) module is applied to model temporal sequence features. Finally, by combining the results of the two modules, the task of dairy goat behavior detection is accomplished. To evaluate the proposed method, we constructed the DairyGoat dataset. Experimental results show that our method achieved a <span><math><mrow><mi>m</mi><mi>A</mi><mi>P</mi></mrow></math></span> value of 78.70%. Additionally, we compared the <span><math><mrow><mi>m</mi><mi>A</mi><mi>P</mi></mrow></math></span> value of our proposed method with other behavior detection models, and the results demonstrate that our method achieves the best detection performance while maintaining a relatively low parameter count and computational load. In summary, this is an effective dairy goat behavior detection method that provides a new strategy for intelligent farming. The dataset and code are available at <span><span>https://github.com/JunpengZZhang/ELSlowFast-LSTM</span><svg><path></path></svg></span>.</div></div>\",\"PeriodicalId\":50627,\"journal\":{\"name\":\"Computers and Electronics in Agriculture\",\"volume\":\"234 \",\"pages\":\"Article 110224\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-03-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers and Electronics in Agriculture\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168169925003308\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169925003308","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
摘要
监测奶山羊的行为可以有效地评估其健康状况和福利水平,保证羊奶的产量和质量。然而,实现对奶山羊行为的准确和快速检测仍然具有挑战性。本研究提出了一种基于YOLO11和ELSlowFast-LSTM (3D-ELA-SlowFast-LSTM)的奶山羊行为检测方法,对奶山羊进行定位,识别站、走、躺、爬、斗五种行为。首先,利用YOLO11目标检测模块对奶山羊进行定位。然后,引入ELSlowFast-LSTM行为识别模块,对检测区域内的行为进行分类。该模块利用SlowFast网络进行时空特征提取,并结合专门设计的3D-Efficient Local (EL) attention机制来增强行为相关特征的提取。此外,采用长短期记忆(LSTM)模块对时间序列特征进行建模。最后,结合两个模块的结果,完成了奶山羊行为检测的任务。为了评估该方法,我们构建了DairyGoat数据集。实验结果表明,该方法的mAP值达到78.70%。此外,我们将所提出方法的mAP值与其他行为检测模型进行了比较,结果表明,我们的方法在保持相对较低的参数计数和计算负荷的情况下实现了最佳的检测性能。综上所述,这是一种有效的奶山羊行为检测方法,为智能养殖提供了新的策略。数据集和代码可在https://github.com/JunpengZZhang/ELSlowFast-LSTM上获得。
Behavior detection of dairy goat based on YOLO11 and ELSlowFast-LSTM
Monitoring dairy goat behavior can effectively assess their health status and welfare levels, ensuring both the yield and quality of goat milk. However, achieving accurate and rapid detection of dairy goat behaviors remains challenging. This study proposes a dairy goat behavior detection method based on YOLO11 and ELSlowFast-LSTM (3D-ELA-SlowFast-LSTM) to locate dairy goats and recognize five behaviors: standing, walking, lying down, climbing, and fighting. Firstly, the YOLO11 object detection module is used to pinpoint the locations of dairy goats. Next, the ELSlowFast-LSTM behavior recognition module is introduced to classify behaviors within the detected regions. This module utilizes the SlowFast network for spatiotemporal feature extraction, incorporating the 3D-Efficient Local (EL) attention mechanism specifically designed to enhance the extraction of behavior-related features. Additionally, the Long Short-Term Memory (LSTM) module is applied to model temporal sequence features. Finally, by combining the results of the two modules, the task of dairy goat behavior detection is accomplished. To evaluate the proposed method, we constructed the DairyGoat dataset. Experimental results show that our method achieved a value of 78.70%. Additionally, we compared the value of our proposed method with other behavior detection models, and the results demonstrate that our method achieves the best detection performance while maintaining a relatively low parameter count and computational load. In summary, this is an effective dairy goat behavior detection method that provides a new strategy for intelligent farming. The dataset and code are available at https://github.com/JunpengZZhang/ELSlowFast-LSTM.
期刊介绍:
Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.