二值分割的多编码器卷积块注意模型

Keita Mamadou, M. Ullah, Ø. Nordbø, F. A. Cheikh
{"title":"二值分割的多编码器卷积块注意模型","authors":"Keita Mamadou, M. Ullah, Ø. Nordbø, F. A. Cheikh","doi":"10.1109/FIT57066.2022.00042","DOIUrl":null,"url":null,"abstract":"Behavioural research in animals can be assisted significantly with an automatic identification system. Such systems can evaluate animals’ behaviour non-intrusively, hence preserving their typical habitat. Recently, methods based on deep learning have shown promising results in this domain. In particular, object and key-point detectors have been used to detect individual animals. Although good results are obtained, bounding boxes and dispersed key points do not follow the animal’s contour, resulting in a large amount of information loss. This work proposed a binary segmentation model that precisely segments individual animal pixels in an indoor setting. In a nutshell, we proposed a new model with multiple encoders and a single decoder incorporating the attention mechanism. The method is tested on a specially created dataset with 1280 hand-labelled images and achieves detection rates of about 91% (dice coefficient) despite perturbations such as occlusions and illumination variations. The results are compared with state-or-the-art segmentation models, and a substantial boost in performance is achieved.","PeriodicalId":102958,"journal":{"name":"2022 International Conference on Frontiers of Information Technology (FIT)","volume":"98 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multi-Encoder Convolution Block Attention Model for Binary Segmentation\",\"authors\":\"Keita Mamadou, M. Ullah, Ø. Nordbø, F. A. Cheikh\",\"doi\":\"10.1109/FIT57066.2022.00042\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Behavioural research in animals can be assisted significantly with an automatic identification system. Such systems can evaluate animals’ behaviour non-intrusively, hence preserving their typical habitat. Recently, methods based on deep learning have shown promising results in this domain. In particular, object and key-point detectors have been used to detect individual animals. Although good results are obtained, bounding boxes and dispersed key points do not follow the animal’s contour, resulting in a large amount of information loss. This work proposed a binary segmentation model that precisely segments individual animal pixels in an indoor setting. In a nutshell, we proposed a new model with multiple encoders and a single decoder incorporating the attention mechanism. The method is tested on a specially created dataset with 1280 hand-labelled images and achieves detection rates of about 91% (dice coefficient) despite perturbations such as occlusions and illumination variations. The results are compared with state-or-the-art segmentation models, and a substantial boost in performance is achieved.\",\"PeriodicalId\":102958,\"journal\":{\"name\":\"2022 International Conference on Frontiers of Information Technology (FIT)\",\"volume\":\"98 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Conference on Frontiers of Information Technology (FIT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/FIT57066.2022.00042\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Conference on Frontiers of Information Technology (FIT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/FIT57066.2022.00042","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

自动识别系统可以极大地辅助动物行为研究。这样的系统可以非侵入性地评估动物的行为,从而保护它们的典型栖息地。近年来,基于深度学习的方法在这一领域取得了可喜的成果。特别是,物体和关键点检测器已被用于检测单个动物。虽然得到了很好的结果,但是边界框和分散的关键点没有跟随动物的轮廓,造成了大量的信息丢失。这项工作提出了一个二元分割模型,精确分割单个动物像素在室内设置。简而言之,我们提出了一个包含注意机制的多个编码器和单个解码器的新模型。该方法在一个特殊创建的数据集上进行了测试,该数据集包含1280张手工标记的图像,尽管存在诸如遮挡和光照变化等扰动,但该方法的检测率仍达到约91%(骰子系数)。将结果与最先进的分割模型进行比较,从而实现了性能的大幅提升。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Multi-Encoder Convolution Block Attention Model for Binary Segmentation
Behavioural research in animals can be assisted significantly with an automatic identification system. Such systems can evaluate animals’ behaviour non-intrusively, hence preserving their typical habitat. Recently, methods based on deep learning have shown promising results in this domain. In particular, object and key-point detectors have been used to detect individual animals. Although good results are obtained, bounding boxes and dispersed key points do not follow the animal’s contour, resulting in a large amount of information loss. This work proposed a binary segmentation model that precisely segments individual animal pixels in an indoor setting. In a nutshell, we proposed a new model with multiple encoders and a single decoder incorporating the attention mechanism. The method is tested on a specially created dataset with 1280 hand-labelled images and achieves detection rates of about 91% (dice coefficient) despite perturbations such as occlusions and illumination variations. The results are compared with state-or-the-art segmentation models, and a substantial boost in performance is achieved.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信