{"title":"FCS-Net:基于 RGB 和热红外图像密集特征融合的肉鸡羽毛状况评分法","authors":"","doi":"10.1016/j.biosystemseng.2024.09.002","DOIUrl":null,"url":null,"abstract":"<div><p>Assessing the feather condition of broilers is crucial for monitoring the animal welfare status and detecting the occurrence of feather pecking activities. Currently, the feather condition of individual broilers is manually scored by trained experts. To provide a more objective and efficient tool for feather condition scoring, a novel deep learning-based model, named Feather Condition Scoring Network (FCS-Net), was proposed based on RGB and thermal infrared images. The FCS-Net model combined the ResNet18 architecture with the proposed Dense Feature Fusion (DFF) module, which can effectively learn the feature mapping relationship between RGB and thermal infrared images. Before inputting the images into the network, an image registration process was conducted to align the RGB and thermal infrared images. The results showed that the FCS-Net model had a good performance for feather condition scoring, with the <em>Accuracy</em> of 97.02%, the <em>Precision</em> of 96.99%, the <em>Recall</em> of 97.04%, the <em>F</em><sub>1</sub> of 97.01%, and the <em>Inference speed</em> of 15.34 fps. Compared to the ResNet18_RGB model, which only utilise RGB images, the FCS-Net model showed notable improvements in <em>Accuracy</em> by 4.02%, <em>Precision</em> by 3.90%, <em>Recall</em> by 4.08%, and <em>F</em><sub>1</sub> by 4.01%. Moreover, it was observed that the FCS-Net model focused more on the back region of the broilers through heatmap visualization. Furthermore, the algorithm was compared with six typical image recognition algorithms including VGG16, ResNet18, SE-ResNet18, DenseNet121, Mobilenet_V2, and Shufflenet_V2_<em>x</em>1_0, as well as the state-of-the-art (SOTA) feather condition assessment methods. The results showed that the FCS-Net model achieved better performance than the six algorithms and the SOTA feather condition assessment methods. This study provided a valuable reference for automated monitoring of feather condition scoring of broilers in smart farming.</p></div>","PeriodicalId":9173,"journal":{"name":"Biosystems Engineering","volume":null,"pages":null},"PeriodicalIF":4.4000,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"FCS-Net: Feather condition scoring of broilers based on dense feature fusion of RGB and thermal infrared images\",\"authors\":\"\",\"doi\":\"10.1016/j.biosystemseng.2024.09.002\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Assessing the feather condition of broilers is crucial for monitoring the animal welfare status and detecting the occurrence of feather pecking activities. Currently, the feather condition of individual broilers is manually scored by trained experts. To provide a more objective and efficient tool for feather condition scoring, a novel deep learning-based model, named Feather Condition Scoring Network (FCS-Net), was proposed based on RGB and thermal infrared images. The FCS-Net model combined the ResNet18 architecture with the proposed Dense Feature Fusion (DFF) module, which can effectively learn the feature mapping relationship between RGB and thermal infrared images. Before inputting the images into the network, an image registration process was conducted to align the RGB and thermal infrared images. The results showed that the FCS-Net model had a good performance for feather condition scoring, with the <em>Accuracy</em> of 97.02%, the <em>Precision</em> of 96.99%, the <em>Recall</em> of 97.04%, the <em>F</em><sub>1</sub> of 97.01%, and the <em>Inference speed</em> of 15.34 fps. Compared to the ResNet18_RGB model, which only utilise RGB images, the FCS-Net model showed notable improvements in <em>Accuracy</em> by 4.02%, <em>Precision</em> by 3.90%, <em>Recall</em> by 4.08%, and <em>F</em><sub>1</sub> by 4.01%. Moreover, it was observed that the FCS-Net model focused more on the back region of the broilers through heatmap visualization. Furthermore, the algorithm was compared with six typical image recognition algorithms including VGG16, ResNet18, SE-ResNet18, DenseNet121, Mobilenet_V2, and Shufflenet_V2_<em>x</em>1_0, as well as the state-of-the-art (SOTA) feather condition assessment methods. The results showed that the FCS-Net model achieved better performance than the six algorithms and the SOTA feather condition assessment methods. This study provided a valuable reference for automated monitoring of feather condition scoring of broilers in smart farming.</p></div>\",\"PeriodicalId\":9173,\"journal\":{\"name\":\"Biosystems Engineering\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2024-09-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biosystems Engineering\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1537511024002046\",\"RegionNum\":1,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AGRICULTURAL ENGINEERING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biosystems Engineering","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1537511024002046","RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURAL ENGINEERING","Score":null,"Total":0}
FCS-Net: Feather condition scoring of broilers based on dense feature fusion of RGB and thermal infrared images
Assessing the feather condition of broilers is crucial for monitoring the animal welfare status and detecting the occurrence of feather pecking activities. Currently, the feather condition of individual broilers is manually scored by trained experts. To provide a more objective and efficient tool for feather condition scoring, a novel deep learning-based model, named Feather Condition Scoring Network (FCS-Net), was proposed based on RGB and thermal infrared images. The FCS-Net model combined the ResNet18 architecture with the proposed Dense Feature Fusion (DFF) module, which can effectively learn the feature mapping relationship between RGB and thermal infrared images. Before inputting the images into the network, an image registration process was conducted to align the RGB and thermal infrared images. The results showed that the FCS-Net model had a good performance for feather condition scoring, with the Accuracy of 97.02%, the Precision of 96.99%, the Recall of 97.04%, the F1 of 97.01%, and the Inference speed of 15.34 fps. Compared to the ResNet18_RGB model, which only utilise RGB images, the FCS-Net model showed notable improvements in Accuracy by 4.02%, Precision by 3.90%, Recall by 4.08%, and F1 by 4.01%. Moreover, it was observed that the FCS-Net model focused more on the back region of the broilers through heatmap visualization. Furthermore, the algorithm was compared with six typical image recognition algorithms including VGG16, ResNet18, SE-ResNet18, DenseNet121, Mobilenet_V2, and Shufflenet_V2_x1_0, as well as the state-of-the-art (SOTA) feather condition assessment methods. The results showed that the FCS-Net model achieved better performance than the six algorithms and the SOTA feather condition assessment methods. This study provided a valuable reference for automated monitoring of feather condition scoring of broilers in smart farming.
期刊介绍:
Biosystems Engineering publishes research in engineering and the physical sciences that represent advances in understanding or modelling of the performance of biological systems for sustainable developments in land use and the environment, agriculture and amenity, bioproduction processes and the food chain. The subject matter of the journal reflects the wide range and interdisciplinary nature of research in engineering for biological systems.