Detectability of multi-dimensional movement and behaviour in cattle using sensor data and machine learning algorithms: Study on a Charolais bull

IF 8.2 Q1 AGRICULTURE, MULTIDISCIPLINARY
Miklós Biszkup , Gábor Vásárhelyi , Nuri Nurlaila Setiawan , Aliz Márton , Szilárd Szentes , Petra Balogh , Barbara Babay-Török , Gábor Pajor , Dóra Drexler
{"title":"Detectability of multi-dimensional movement and behaviour in cattle using sensor data and machine learning algorithms: Study on a Charolais bull","authors":"Miklós Biszkup ,&nbsp;Gábor Vásárhelyi ,&nbsp;Nuri Nurlaila Setiawan ,&nbsp;Aliz Márton ,&nbsp;Szilárd Szentes ,&nbsp;Petra Balogh ,&nbsp;Barbara Babay-Török ,&nbsp;Gábor Pajor ,&nbsp;Dóra Drexler","doi":"10.1016/j.aiia.2024.11.002","DOIUrl":null,"url":null,"abstract":"<div><div>The development of motion sensors for monitoring cattle behaviour has enabled farmers to predict the state of their cattle's welfare more efficiently. While most studies work with one dimensional output with disjunct behaviour categories, more accurate prediction can still be achieved by including complex movements and enriching the sensor algorithm to detect multi-dimensional movements, i.e., more than one movement occurring simultaneously. This paper presents such a machine-learning method for analysing overlapping independent movements. The output of the method consists of automatically recognized complex behaviour patterns that can be used for measuring animal welfare, predicting calving, or detecting early signs of diseases. This study combines automated motion sensors (i.e., halter and pedometer) for ruminants known as RumiWatch mounted on a Charolais fattening bull and camera observation. Fourteen types of complex movements were identified, i.e., defecating-urinating, eating, drinking, getting up, head movement, licking, lying down, lying, playing-aggression, rubbing, ruminating, sleeping, standing, and stepping. As multiple parallel binary classificators were used, the system was able to recognize parallel behavioural patterns with high fidelity. Two types of machine learning, i.e., Support Vector Classification (SVC) and RandomForest were used to recognize different general and non-general forms of movement. Results from these two supervised learning systems were compared. A continuous forty-eight hours of video were annotated to train the systems and validate their predictions. The success rate of both classifiers in recognizing special movements from both sensors or separately in different settings (i.e., window and padding) was examined. Although the two classifiers produced different results, the ideal settings showed that all forms of movement in the subject animal were successfully recognized with high accuracy. More studies using more individual animals and different ruminants would increase our knowledge on enhancing the system's performance and accuracy.</div></div>","PeriodicalId":52814,"journal":{"name":"Artificial Intelligence in Agriculture","volume":"14 ","pages":"Pages 86-98"},"PeriodicalIF":8.2000,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial Intelligence in Agriculture","FirstCategoryId":"1087","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2589721724000412","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

The development of motion sensors for monitoring cattle behaviour has enabled farmers to predict the state of their cattle's welfare more efficiently. While most studies work with one dimensional output with disjunct behaviour categories, more accurate prediction can still be achieved by including complex movements and enriching the sensor algorithm to detect multi-dimensional movements, i.e., more than one movement occurring simultaneously. This paper presents such a machine-learning method for analysing overlapping independent movements. The output of the method consists of automatically recognized complex behaviour patterns that can be used for measuring animal welfare, predicting calving, or detecting early signs of diseases. This study combines automated motion sensors (i.e., halter and pedometer) for ruminants known as RumiWatch mounted on a Charolais fattening bull and camera observation. Fourteen types of complex movements were identified, i.e., defecating-urinating, eating, drinking, getting up, head movement, licking, lying down, lying, playing-aggression, rubbing, ruminating, sleeping, standing, and stepping. As multiple parallel binary classificators were used, the system was able to recognize parallel behavioural patterns with high fidelity. Two types of machine learning, i.e., Support Vector Classification (SVC) and RandomForest were used to recognize different general and non-general forms of movement. Results from these two supervised learning systems were compared. A continuous forty-eight hours of video were annotated to train the systems and validate their predictions. The success rate of both classifiers in recognizing special movements from both sensors or separately in different settings (i.e., window and padding) was examined. Although the two classifiers produced different results, the ideal settings showed that all forms of movement in the subject animal were successfully recognized with high accuracy. More studies using more individual animals and different ruminants would increase our knowledge on enhancing the system's performance and accuracy.
利用传感器数据和机器学习算法检测牛的多维运动和行为:夏洛莱公牛研究
用于监测牛只行为的运动传感器的开发使农民能够更有效地预测牛只的福利状况。虽然大多数研究使用的是一维输出和不相关的行为类别,但如果将复杂的动作包括在内,并丰富传感器算法以检测多维动作(即同时发生多个动作),仍可实现更准确的预测。本文介绍了这种用于分析重叠独立动作的机器学习方法。该方法的输出包括自动识别的复杂行为模式,可用于测量动物福利、预测产犊或检测疾病的早期征兆。这项研究结合了安装在夏洛莱育肥公牛身上的反刍动物自动运动传感器(即缰绳和计步器)(称为 RumiWatch)和摄像头观察。研究发现了 14 种复杂运动,即排便-排尿、进食、饮水、起身、头部运动、舔食、躺下、趴着、玩耍-攻击、摩擦、反刍、睡觉、站立和迈步。由于使用了多个并行二进制分类器,该系统能够高保真地识别并行的行为模式。支持向量分类(SVC)和随机森林(RandomForest)这两种机器学习方法被用于识别不同的一般和非一般运动形式。对这两种监督学习系统的结果进行了比较。对连续 48 小时的视频进行了注释,以训练系统并验证其预测结果。研究还考察了两种分类器在识别来自两个传感器或在不同设置(即窗口和填充)下分别识别特殊运动时的成功率。虽然两种分类器产生的结果不同,但理想的设置表明,受试动物的所有运动形式都能成功识别,而且准确率很高。使用更多的动物个体和不同的反刍动物进行更多的研究将增加我们对提高系统性能和准确性的了解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Artificial Intelligence in Agriculture
Artificial Intelligence in Agriculture Engineering-Engineering (miscellaneous)
CiteScore
21.60
自引率
0.00%
发文量
18
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信