手势引导人机协作系统的数字双胞胎

IF 1.9 3区 工程技术 Q3 ENGINEERING, MANUFACTURING
Ao Liu, Yifan Zhang, Yuan Yao
{"title":"手势引导人机协作系统的数字双胞胎","authors":"Ao Liu, Yifan Zhang, Yuan Yao","doi":"10.1177/09544054231223783","DOIUrl":null,"url":null,"abstract":"Gesture control is one of the effective and flexible communication method between humans and robots. However, it always depends on complex hardware and configurations in human-robot collaboration systems. Simplifying the design of gesture-interaction systems and avoiding miscommunication are challenging problems. In this paper, we proposed a method that utilizes an RGB sensor to realize spatial human-robot collaboration. A random forest based depth estimator is presented to supplement the additional spatial information for hand gesture recognition. Additionally, we demonstrate the construction of secure human-robot collaboration scenarios in Unity and validate our approach in real-world settings, based on which a digital twin system oriented to human-machine collaboration is constructed to realize rapid human-machine task simulation, safety specification testing, and real-scene applications development.","PeriodicalId":20663,"journal":{"name":"Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture","volume":null,"pages":null},"PeriodicalIF":1.9000,"publicationDate":"2024-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Digital twins for hand gesture-guided human-robot collaboration systems\",\"authors\":\"Ao Liu, Yifan Zhang, Yuan Yao\",\"doi\":\"10.1177/09544054231223783\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Gesture control is one of the effective and flexible communication method between humans and robots. However, it always depends on complex hardware and configurations in human-robot collaboration systems. Simplifying the design of gesture-interaction systems and avoiding miscommunication are challenging problems. In this paper, we proposed a method that utilizes an RGB sensor to realize spatial human-robot collaboration. A random forest based depth estimator is presented to supplement the additional spatial information for hand gesture recognition. Additionally, we demonstrate the construction of secure human-robot collaboration scenarios in Unity and validate our approach in real-world settings, based on which a digital twin system oriented to human-machine collaboration is constructed to realize rapid human-machine task simulation, safety specification testing, and real-scene applications development.\",\"PeriodicalId\":20663,\"journal\":{\"name\":\"Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2024-01-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1177/09544054231223783\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1177/09544054231223783","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0

摘要

手势控制是人类与机器人之间有效而灵活的交流方式之一。然而,在人机协作系统中,它始终依赖于复杂的硬件和配置。简化手势交互系统的设计并避免误传是一个具有挑战性的问题。本文提出了一种利用 RGB 传感器实现空间人机协作的方法。本文提出了一种基于随机森林的深度估计器,以补充手势识别的额外空间信息。此外,我们还演示了在 Unity 中构建安全的人机协作场景,并在现实环境中验证了我们的方法,在此基础上构建了面向人机协作的数字孪生系统,以实现快速的人机任务模拟、安全规范测试和真实场景应用开发。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Digital twins for hand gesture-guided human-robot collaboration systems
Gesture control is one of the effective and flexible communication method between humans and robots. However, it always depends on complex hardware and configurations in human-robot collaboration systems. Simplifying the design of gesture-interaction systems and avoiding miscommunication are challenging problems. In this paper, we proposed a method that utilizes an RGB sensor to realize spatial human-robot collaboration. A random forest based depth estimator is presented to supplement the additional spatial information for hand gesture recognition. Additionally, we demonstrate the construction of secure human-robot collaboration scenarios in Unity and validate our approach in real-world settings, based on which a digital twin system oriented to human-machine collaboration is constructed to realize rapid human-machine task simulation, safety specification testing, and real-scene applications development.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
5.10
自引率
30.80%
发文量
167
审稿时长
5.1 months
期刊介绍: Manufacturing industries throughout the world are changing very rapidly. New concepts and methods are being developed and exploited to enable efficient and effective manufacturing. Existing manufacturing processes are being improved to meet the requirements of lean and agile manufacturing. The aim of the Journal of Engineering Manufacture is to provide a focus for these developments in engineering manufacture by publishing original papers and review papers covering technological and scientific research, developments and management implementation in manufacturing. This journal is also peer reviewed. Contributions are welcomed in the broad areas of manufacturing processes, manufacturing technology and factory automation, digital manufacturing, design and manufacturing systems including management relevant to engineering manufacture. Of particular interest at the present time would be papers concerned with digital manufacturing, metrology enabled manufacturing, smart factory, additive manufacturing and composites as well as specialist manufacturing fields like nanotechnology, sustainable & clean manufacturing and bio-manufacturing. Articles may be Research Papers, Reviews, Technical Notes, or Short Communications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信