Quadruped robot-enabled framework for intelligent sidewalk condition monitoring

IF 11.5 1区 工程技术 Q1 CONSTRUCTION & BUILDING TECHNOLOGY
Jinze Luo , Qianxun Yang , Yumeng Sun , Lunpeng Li , Wenyuan Cai , Yuchuan Du , Chenglong Liu
{"title":"Quadruped robot-enabled framework for intelligent sidewalk condition monitoring","authors":"Jinze Luo ,&nbsp;Qianxun Yang ,&nbsp;Yumeng Sun ,&nbsp;Lunpeng Li ,&nbsp;Wenyuan Cai ,&nbsp;Yuchuan Du ,&nbsp;Chenglong Liu","doi":"10.1016/j.autcon.2025.106600","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate detection of sidewalk conditions is critical for enhancing the safety and efficiency of urban non-motorized transportation systems. Existing manual inspection methods, while effective for limited scenarios, fall short in terms of efficiency, coverage, and the detection of concealed defects. This paper introduces a sidewalk inspection framework that leverages a quadruped robot equipped with visual and vibration sensors to comprehensively address complex pavement scenes and hidden loosened bricks. For visual inspection, an improved YOLO11 model with a dynamic attention-weighted sampling mechanism enhances detection accuracy for minority-class defects, achieving a mAP of 0.883. For hidden defect identification, a Physics-Informed Neural Network with a Long Short-Term Memory network (PINN-LSTM) is proposed to fuse physical constraints with temporal patterns, achieving an overall accuracy of 0.9430. The value of the physics-informed approach is further substantiated by its performance in cross-domain generalization, few-shot adaptation, and robustness tests, confirming its potential for practical applications.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"181 ","pages":"Article 106600"},"PeriodicalIF":11.5000,"publicationDate":"2025-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automation in Construction","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0926580525006405","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Accurate detection of sidewalk conditions is critical for enhancing the safety and efficiency of urban non-motorized transportation systems. Existing manual inspection methods, while effective for limited scenarios, fall short in terms of efficiency, coverage, and the detection of concealed defects. This paper introduces a sidewalk inspection framework that leverages a quadruped robot equipped with visual and vibration sensors to comprehensively address complex pavement scenes and hidden loosened bricks. For visual inspection, an improved YOLO11 model with a dynamic attention-weighted sampling mechanism enhances detection accuracy for minority-class defects, achieving a mAP of 0.883. For hidden defect identification, a Physics-Informed Neural Network with a Long Short-Term Memory network (PINN-LSTM) is proposed to fuse physical constraints with temporal patterns, achieving an overall accuracy of 0.9430. The value of the physics-informed approach is further substantiated by its performance in cross-domain generalization, few-shot adaptation, and robustness tests, confirming its potential for practical applications.
智能人行道状况监测的四足机器人框架
人行道状况的准确检测对于提高城市非机动交通系统的安全性和效率至关重要。现有的人工检查方法虽然在有限的情况下是有效的,但在效率、覆盖范围和对隐藏缺陷的检测方面存在不足。本文介绍了一种人行道检测框架,该框架利用配备视觉和振动传感器的四足机器人来综合处理复杂的路面场景和隐藏的松动砖块。在视觉检测方面,改进的YOLO11模型采用动态注意力加权抽样机制,提高了对少数类缺陷的检测精度,mAP值为0.883。对于隐藏缺陷的识别,提出了一种基于长短期记忆网络的物理信息神经网络(PINN-LSTM),将物理约束与时间模式融合,总体准确率为0.9430。物理信息方法在跨域泛化、少量自适应和鲁棒性测试中的表现进一步证实了其价值,证实了其实际应用的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Automation in Construction
Automation in Construction 工程技术-工程:土木
CiteScore
19.20
自引率
16.50%
发文量
563
审稿时长
8.5 months
期刊介绍: Automation in Construction is an international journal that focuses on publishing original research papers related to the use of Information Technologies in various aspects of the construction industry. The journal covers topics such as design, engineering, construction technologies, and the maintenance and management of constructed facilities. The scope of Automation in Construction is extensive and covers all stages of the construction life cycle. This includes initial planning and design, construction of the facility, operation and maintenance, as well as the eventual dismantling and recycling of buildings and engineering structures.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信