PointDet:一种基于人类局部特征的违例识别目标检测框架

Yudi Tang, Bing Wang, Wangli He, Feng Qian
{"title":"PointDet:一种基于人类局部特征的违例识别目标检测框架","authors":"Yudi Tang, Bing Wang, Wangli He, Feng Qian","doi":"10.1109/ICIST52614.2021.9440553","DOIUrl":null,"url":null,"abstract":"Object detection algorithms play an important role in the field of violation detection. However, small target detection is full of challenges in scenes related to human. The relationship between objects is usually not considered in object detection algorithms, which will make the model over relay on the high-order features and not make full use of local features. To address this issue, a novel framework named PointDet is proposed to learn local features which optimizes the detection effect of small targets in chemical plants. Since most of the targets to be detected in our dataset are highly correlated with human, human local features are used when designing the framework. First, we use a trained pose estimation model to extract local key point features. However, if local features are used directly, the relationship between them cannot be fully considered. Based on this situation, we have designed the one-vs-others module and the adaptive-graph-convolution module to reconstruct local features. In addition, for the output layer, the most challenging problem is how to better detect small targets. In our task, various small objects such as gloves, goggles, etc. have an obvious positional relationship with the local features of human body. In the output layer, we have designed a head attention module to make full use of this situation to optimize the small target detection problem. Specifically, our framework significantly outperforms state-of-the-art by 7.8 AP scores on field work dataset in chemical plants.","PeriodicalId":371599,"journal":{"name":"2021 11th International Conference on Information Science and Technology (ICIST)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"PointDet: An Object Detection Framework Based On Human local Features In The Task Of Identifying Violations\",\"authors\":\"Yudi Tang, Bing Wang, Wangli He, Feng Qian\",\"doi\":\"10.1109/ICIST52614.2021.9440553\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Object detection algorithms play an important role in the field of violation detection. However, small target detection is full of challenges in scenes related to human. The relationship between objects is usually not considered in object detection algorithms, which will make the model over relay on the high-order features and not make full use of local features. To address this issue, a novel framework named PointDet is proposed to learn local features which optimizes the detection effect of small targets in chemical plants. Since most of the targets to be detected in our dataset are highly correlated with human, human local features are used when designing the framework. First, we use a trained pose estimation model to extract local key point features. However, if local features are used directly, the relationship between them cannot be fully considered. Based on this situation, we have designed the one-vs-others module and the adaptive-graph-convolution module to reconstruct local features. In addition, for the output layer, the most challenging problem is how to better detect small targets. In our task, various small objects such as gloves, goggles, etc. have an obvious positional relationship with the local features of human body. In the output layer, we have designed a head attention module to make full use of this situation to optimize the small target detection problem. Specifically, our framework significantly outperforms state-of-the-art by 7.8 AP scores on field work dataset in chemical plants.\",\"PeriodicalId\":371599,\"journal\":{\"name\":\"2021 11th International Conference on Information Science and Technology (ICIST)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-05-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 11th International Conference on Information Science and Technology (ICIST)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICIST52614.2021.9440553\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 11th International Conference on Information Science and Technology (ICIST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICIST52614.2021.9440553","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

目标检测算法在违例检测领域中起着重要的作用。然而,在与人类相关的场景中,小目标检测充满了挑战。在目标检测算法中,通常不考虑目标之间的关系,这会使模型过度依赖于高阶特征,而不能充分利用局部特征。为了解决这一问题,提出了一种新的学习局部特征的框架PointDet,优化了化工厂小目标的检测效果。由于我们的数据集中检测的大多数目标与人类高度相关,因此在设计框架时使用了人类的局部特征。首先,利用训练好的姿态估计模型提取局部关键点特征;但是,如果直接使用局部特征,则不能充分考虑它们之间的关系。基于这种情况,我们设计了一对一模块和自适应图卷积模块来重建局部特征。此外,对于输出层来说,最具挑战性的问题是如何更好地检测小目标。在我们的任务中,手套、护目镜等各种小物体与人体的局部特征有着明显的位置关系。在输出层,我们设计了头部注意模块,充分利用这种情况来优化小目标检测问题。具体来说,我们的框架在化工厂的实地工作数据集上明显优于最先进的7.8 AP得分。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
PointDet: An Object Detection Framework Based On Human local Features In The Task Of Identifying Violations
Object detection algorithms play an important role in the field of violation detection. However, small target detection is full of challenges in scenes related to human. The relationship between objects is usually not considered in object detection algorithms, which will make the model over relay on the high-order features and not make full use of local features. To address this issue, a novel framework named PointDet is proposed to learn local features which optimizes the detection effect of small targets in chemical plants. Since most of the targets to be detected in our dataset are highly correlated with human, human local features are used when designing the framework. First, we use a trained pose estimation model to extract local key point features. However, if local features are used directly, the relationship between them cannot be fully considered. Based on this situation, we have designed the one-vs-others module and the adaptive-graph-convolution module to reconstruct local features. In addition, for the output layer, the most challenging problem is how to better detect small targets. In our task, various small objects such as gloves, goggles, etc. have an obvious positional relationship with the local features of human body. In the output layer, we have designed a head attention module to make full use of this situation to optimize the small target detection problem. Specifically, our framework significantly outperforms state-of-the-art by 7.8 AP scores on field work dataset in chemical plants.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信