基于人级联网络的遮挡行人鲁棒检测

Zhewei Xu, Xiufeng Fu, Da Feng, Wei Li, Yang Liu
{"title":"基于人级联网络的遮挡行人鲁棒检测","authors":"Zhewei Xu, Xiufeng Fu, Da Feng, Wei Li, Yang Liu","doi":"10.1109/cniot55862.2022.00045","DOIUrl":null,"url":null,"abstract":"Occlusion is a key challenge in real-world on-road pedestrian detection task. Due to constrained viewpoint geometry, a pedestrian is very likely to be obstructed by other pedestrians and/or other objects such as cars and bicycles. For Advanced Driver Assistance System (ADAS), heavily occluded pedestrians are as important as reasonable pedestrians because they may burst out from crowds or roadside obstacles. In this paper, a human-cascaded network is proposed for robust detection of heavily occluded pedestrians. Specifically, a sharp-response proposal network (SRPN) is designed to refine the feature responses in a narrow area to handle crowded pedestrian detection, followed by outputting the head and full body proposals for diverse occlusion situations. After RoI-pooling, a visible-guided attention (VGA) module is developed to leverage the head and visible area information. The VGA module also suppresses the feature noise of occluded area to enhance the feature representation learning of the backbone network. Finally, a head-cascade RCNN (HRCNN) network is proposed to predict the pedestrian bounding box from the head proposal. The proposed approach is validated through a widely used pedestrian detection dataset: CityPersons. Experimental results show that our approach achieves promising detection performance (log-average miss rate, MR) improvement of 11.4% on heavy occlusion subset, compared to the baseline detector.","PeriodicalId":251734,"journal":{"name":"2022 3rd International Conference on Computing, Networks and Internet of Things (CNIOT)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Human-Cascaded network for Robust Detection of Occluded Pedestrian\",\"authors\":\"Zhewei Xu, Xiufeng Fu, Da Feng, Wei Li, Yang Liu\",\"doi\":\"10.1109/cniot55862.2022.00045\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Occlusion is a key challenge in real-world on-road pedestrian detection task. Due to constrained viewpoint geometry, a pedestrian is very likely to be obstructed by other pedestrians and/or other objects such as cars and bicycles. For Advanced Driver Assistance System (ADAS), heavily occluded pedestrians are as important as reasonable pedestrians because they may burst out from crowds or roadside obstacles. In this paper, a human-cascaded network is proposed for robust detection of heavily occluded pedestrians. Specifically, a sharp-response proposal network (SRPN) is designed to refine the feature responses in a narrow area to handle crowded pedestrian detection, followed by outputting the head and full body proposals for diverse occlusion situations. After RoI-pooling, a visible-guided attention (VGA) module is developed to leverage the head and visible area information. The VGA module also suppresses the feature noise of occluded area to enhance the feature representation learning of the backbone network. Finally, a head-cascade RCNN (HRCNN) network is proposed to predict the pedestrian bounding box from the head proposal. The proposed approach is validated through a widely used pedestrian detection dataset: CityPersons. Experimental results show that our approach achieves promising detection performance (log-average miss rate, MR) improvement of 11.4% on heavy occlusion subset, compared to the baseline detector.\",\"PeriodicalId\":251734,\"journal\":{\"name\":\"2022 3rd International Conference on Computing, Networks and Internet of Things (CNIOT)\",\"volume\":\"4 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 3rd International Conference on Computing, Networks and Internet of Things (CNIOT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/cniot55862.2022.00045\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 3rd International Conference on Computing, Networks and Internet of Things (CNIOT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/cniot55862.2022.00045","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

遮挡是现实世界道路行人检测任务中的一个关键挑战。由于视点几何形状的限制,行人很可能被其他行人和/或其他物体(如汽车和自行车)阻挡。对于高级驾驶辅助系统(ADAS),严重闭塞的行人与合理的行人一样重要,因为他们可能会从人群或路边障碍物中冲出。本文提出了一种人类级联网络,用于严重遮挡行人的鲁棒检测。具体而言,设计了一个快速响应建议网络(SRPN),用于细化窄区域内的特征响应以处理拥挤的行人检测,然后输出不同遮挡情况下的头部和全身建议。在roi池之后,开发了可视引导注意力(VGA)模块来利用头部和可见区域信息。VGA模块还对遮挡区域的特征噪声进行抑制,增强骨干网的特征表示学习能力。最后,提出了一种头部级联RCNN (HRCNN)网络,从头部建议中预测行人边界盒。该方法通过广泛使用的行人检测数据集CityPersons进行了验证。实验结果表明,与基线检测器相比,我们的方法在重遮挡子集上的检测性能(对数平均缺失率,MR)提高了11.4%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Human-Cascaded network for Robust Detection of Occluded Pedestrian
Occlusion is a key challenge in real-world on-road pedestrian detection task. Due to constrained viewpoint geometry, a pedestrian is very likely to be obstructed by other pedestrians and/or other objects such as cars and bicycles. For Advanced Driver Assistance System (ADAS), heavily occluded pedestrians are as important as reasonable pedestrians because they may burst out from crowds or roadside obstacles. In this paper, a human-cascaded network is proposed for robust detection of heavily occluded pedestrians. Specifically, a sharp-response proposal network (SRPN) is designed to refine the feature responses in a narrow area to handle crowded pedestrian detection, followed by outputting the head and full body proposals for diverse occlusion situations. After RoI-pooling, a visible-guided attention (VGA) module is developed to leverage the head and visible area information. The VGA module also suppresses the feature noise of occluded area to enhance the feature representation learning of the backbone network. Finally, a head-cascade RCNN (HRCNN) network is proposed to predict the pedestrian bounding box from the head proposal. The proposed approach is validated through a widely used pedestrian detection dataset: CityPersons. Experimental results show that our approach achieves promising detection performance (log-average miss rate, MR) improvement of 11.4% on heavy occlusion subset, compared to the baseline detector.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信