{"title":"设计用于制造业远程操作的人机认知界面的多模式反馈通道","authors":"Chen Zheng, Kangning Wang, Shiqi Gao, Yang Yu, Zhanxi Wang, Yunlong Tang","doi":"10.1007/s10845-024-02451-x","DOIUrl":null,"url":null,"abstract":"<p>Teleoperation, which is a specific mode of human–robot collaboration enabling a human operator to provide instructions and monitor the actions of the robot remotely, has proved beneficial for application to hazardous and unstructured manufacturing environments. Despite the design of a command channel from human operators to robots, most existing studies on teleoperation fail to focus on the design of the feedback channel from the robot to the human operator, which plays a crucial role in reducing the cognitive load, particularly in precise and concentrated manufacturing tasks. This paper focuses on designing a feedback channel for the cognitive interface between a human operator and a robot considering human cognition. Current studies on human–robot cognitive interfaces in robot teleoperation are extensively surveyed. Further, the modalities of human cognition that foster understanding and transparency during teleoperation are identified. In addition, the human–robot cognitive interface, which utilizes the proposed multi-modal feedback channel, is developed on a teleoperated robotic grasping system as a case study. Finally, a series of experiments based on different modal feedback channels are conducted to demonstrate the effectiveness of enhancing the performance of the teleoperated grasping of fragile products and reducing the cognitive load via the objective aspects of experimental results and the subjective aspects of operator feedback.</p>","PeriodicalId":16193,"journal":{"name":"Journal of Intelligent Manufacturing","volume":"52 1","pages":""},"PeriodicalIF":5.9000,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Design of multi-modal feedback channel of human–robot cognitive interface for teleoperation in manufacturing\",\"authors\":\"Chen Zheng, Kangning Wang, Shiqi Gao, Yang Yu, Zhanxi Wang, Yunlong Tang\",\"doi\":\"10.1007/s10845-024-02451-x\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Teleoperation, which is a specific mode of human–robot collaboration enabling a human operator to provide instructions and monitor the actions of the robot remotely, has proved beneficial for application to hazardous and unstructured manufacturing environments. Despite the design of a command channel from human operators to robots, most existing studies on teleoperation fail to focus on the design of the feedback channel from the robot to the human operator, which plays a crucial role in reducing the cognitive load, particularly in precise and concentrated manufacturing tasks. This paper focuses on designing a feedback channel for the cognitive interface between a human operator and a robot considering human cognition. Current studies on human–robot cognitive interfaces in robot teleoperation are extensively surveyed. Further, the modalities of human cognition that foster understanding and transparency during teleoperation are identified. In addition, the human–robot cognitive interface, which utilizes the proposed multi-modal feedback channel, is developed on a teleoperated robotic grasping system as a case study. Finally, a series of experiments based on different modal feedback channels are conducted to demonstrate the effectiveness of enhancing the performance of the teleoperated grasping of fragile products and reducing the cognitive load via the objective aspects of experimental results and the subjective aspects of operator feedback.</p>\",\"PeriodicalId\":16193,\"journal\":{\"name\":\"Journal of Intelligent Manufacturing\",\"volume\":\"52 1\",\"pages\":\"\"},\"PeriodicalIF\":5.9000,\"publicationDate\":\"2024-07-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Intelligent Manufacturing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1007/s10845-024-02451-x\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Intelligent Manufacturing","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s10845-024-02451-x","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Design of multi-modal feedback channel of human–robot cognitive interface for teleoperation in manufacturing
Teleoperation, which is a specific mode of human–robot collaboration enabling a human operator to provide instructions and monitor the actions of the robot remotely, has proved beneficial for application to hazardous and unstructured manufacturing environments. Despite the design of a command channel from human operators to robots, most existing studies on teleoperation fail to focus on the design of the feedback channel from the robot to the human operator, which plays a crucial role in reducing the cognitive load, particularly in precise and concentrated manufacturing tasks. This paper focuses on designing a feedback channel for the cognitive interface between a human operator and a robot considering human cognition. Current studies on human–robot cognitive interfaces in robot teleoperation are extensively surveyed. Further, the modalities of human cognition that foster understanding and transparency during teleoperation are identified. In addition, the human–robot cognitive interface, which utilizes the proposed multi-modal feedback channel, is developed on a teleoperated robotic grasping system as a case study. Finally, a series of experiments based on different modal feedback channels are conducted to demonstrate the effectiveness of enhancing the performance of the teleoperated grasping of fragile products and reducing the cognitive load via the objective aspects of experimental results and the subjective aspects of operator feedback.
期刊介绍:
The Journal of Nonlinear Engineering aims to be a platform for sharing original research results in theoretical, experimental, practical, and applied nonlinear phenomena within engineering. It serves as a forum to exchange ideas and applications of nonlinear problems across various engineering disciplines. Articles are considered for publication if they explore nonlinearities in engineering systems, offering realistic mathematical modeling, utilizing nonlinearity for new designs, stabilizing systems, understanding system behavior through nonlinearity, optimizing systems based on nonlinear interactions, and developing algorithms to harness and leverage nonlinear elements.