YOLO-BYTE: An efficient multi-object tracking algorithm for automatic monitoring of dairy cows

IF 7.7 1区 农林科学 Q1 AGRICULTURE, MULTIDISCIPLINARY
Zhiyang Zheng, Jingwen Li, Lifeng Qin
{"title":"YOLO-BYTE: An efficient multi-object tracking algorithm for automatic monitoring of dairy cows","authors":"Zhiyang Zheng,&nbsp;Jingwen Li,&nbsp;Lifeng Qin","doi":"10.1016/j.compag.2023.107857","DOIUrl":null,"url":null,"abstract":"<div><p>Dairy cows tracking is an essential means to obtain their behavioral information, real-time position, activity data, and health status. A multi-object tracking method (YOLO-BYTE) is proposed to address the problem of missed detection and false detection caused by complex environments in cow individual detection and tracking. The method improves upon the YOLO v7 Backbone<span> network feature extraction module by adding a Self-Attention and Convolution mixed module (ACmix) to account for the uneven spatial distribution and target scale variation of the cows. Additionally, in order to reduce the number of model parameters, an improved lightweight Spatial Pyramid Pooling Cross Stage Partial Connections (SPPCSPC-L) module is adopted to reduce model complexity. At the same time, the state parameters in the Kalman filter are improved by directly predicting the width and height information of the tracking boxes, so as to improve the ByteTrack algorithm to make tracking boxes matching the cows more precisely and accurately. Experimental conducted on the dairy cow object detection and multi-object tracking dataset show that the proposed YOLO-BYTE model achieves a Precision (P) of 97.3% in the dairy cow target detection dataset, with an improved Recall (R) and Average Precision (AP) by 1.1% compared to the original algorithm, and an 18% reduction in model parameters. Moreover, the proposed method demonstrated significant improvements in High Order Tracking Accuracy (HOTA), Multi-Object Tracking Accuracy (MOTA), and Identification F1 (IDF1) by 4.4%, 6.1%, and 3.8%, respectively, compared to the original model, with a decrease of 37.5% in Identity Switch (IDS). The tracker runs in a real-time manner with an average analysis speed of 47 fps. Hence, it is demonstrated that the proposed approach is capable of effective multi-object tracking of dairy cows in natural scenes and provides technical support for non-contact dairy cow automatic monitoring.</span></p></div>","PeriodicalId":50627,"journal":{"name":"Computers and Electronics in Agriculture","volume":null,"pages":null},"PeriodicalIF":7.7000,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers and Electronics in Agriculture","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168169923002454","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

Dairy cows tracking is an essential means to obtain their behavioral information, real-time position, activity data, and health status. A multi-object tracking method (YOLO-BYTE) is proposed to address the problem of missed detection and false detection caused by complex environments in cow individual detection and tracking. The method improves upon the YOLO v7 Backbone network feature extraction module by adding a Self-Attention and Convolution mixed module (ACmix) to account for the uneven spatial distribution and target scale variation of the cows. Additionally, in order to reduce the number of model parameters, an improved lightweight Spatial Pyramid Pooling Cross Stage Partial Connections (SPPCSPC-L) module is adopted to reduce model complexity. At the same time, the state parameters in the Kalman filter are improved by directly predicting the width and height information of the tracking boxes, so as to improve the ByteTrack algorithm to make tracking boxes matching the cows more precisely and accurately. Experimental conducted on the dairy cow object detection and multi-object tracking dataset show that the proposed YOLO-BYTE model achieves a Precision (P) of 97.3% in the dairy cow target detection dataset, with an improved Recall (R) and Average Precision (AP) by 1.1% compared to the original algorithm, and an 18% reduction in model parameters. Moreover, the proposed method demonstrated significant improvements in High Order Tracking Accuracy (HOTA), Multi-Object Tracking Accuracy (MOTA), and Identification F1 (IDF1) by 4.4%, 6.1%, and 3.8%, respectively, compared to the original model, with a decrease of 37.5% in Identity Switch (IDS). The tracker runs in a real-time manner with an average analysis speed of 47 fps. Hence, it is demonstrated that the proposed approach is capable of effective multi-object tracking of dairy cows in natural scenes and provides technical support for non-contact dairy cow automatic monitoring.

YOLO-BYTE:一种用于奶牛自动监测的高效多目标跟踪算法
奶牛跟踪是获取其行为信息、实时位置、活动数据和健康状况的重要手段。针对奶牛个体检测和跟踪中复杂环境造成的漏检和误检问题,提出了一种多目标跟踪方法(YOLO-BYTE)。该方法对YOLO v7骨干网络特征提取模块进行了改进,增加了自注意和卷积混合模块(ACmix),以解决奶牛的不均匀空间分布和目标规模变化。此外,为了减少模型参数的数量,采用了一种改进的轻量级空间金字塔池跨阶段部分连接(SPPCPC-L)模块来降低模型的复杂性。同时,通过直接预测跟踪框的宽度和高度信息来改进卡尔曼滤波器中的状态参数,从而改进ByteTrack算法,使跟踪框与奶牛匹配得更精确、更准确。对奶牛目标检测和多目标跟踪数据集进行的实验表明,所提出的YOLO-BYTE模型在奶牛目标检测数据集中实现了97.3%的精度(P),与原始算法相比,召回率(R)和平均精度(AP)提高了1.1%,模型参数减少了18%。此外,与原始模型相比,所提出的方法在高阶跟踪精度(HOTA)、多目标跟踪精度(MOTA)和识别F1(IDF1)方面分别提高了4.4%、6.1%和3.8%,在身份切换(IDS)中降低了37.5%。跟踪器以实时方式运行,平均分析速度为47fps。因此,该方法能够在自然场景中对奶牛进行有效的多目标跟踪,为非接触式奶牛自动监测提供了技术支持。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computers and Electronics in Agriculture
Computers and Electronics in Agriculture 工程技术-计算机:跨学科应用
CiteScore
15.30
自引率
14.50%
发文量
800
审稿时长
62 days
期刊介绍: Computers and Electronics in Agriculture provides international coverage of advancements in computer hardware, software, electronic instrumentation, and control systems applied to agricultural challenges. Encompassing agronomy, horticulture, forestry, aquaculture, and animal farming, the journal publishes original papers, reviews, and applications notes. It explores the use of computers and electronics in plant or animal agricultural production, covering topics like agricultural soils, water, pests, controlled environments, and waste. The scope extends to on-farm post-harvest operations and relevant technologies, including artificial intelligence, sensors, machine vision, robotics, networking, and simulation modeling. Its companion journal, Smart Agricultural Technology, continues the focus on smart applications in production agriculture.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信