Dual-Modality Haptic Feedback Improves Dexterous Task Execution With Virtual EMG-Controlled Gripper

IF 2.4 3区计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS

IEEE Transactions on Haptics Pub Date : 2023-10-30 DOI:10.1109/TOH.2023.3328256

Kezi Li;Jeremy D. Brown

{"title":"Dual-Modality Haptic Feedback Improves Dexterous Task Execution With Virtual EMG-Controlled Gripper","authors":"Kezi Li;Jeremy D. Brown","doi":"10.1109/TOH.2023.3328256","DOIUrl":null,"url":null,"abstract":"Individuals with upper-extremity limb difference who use myoelectric prostheses currently lack the haptic sensory information needed to perform dexterous activities of daily living. While considerable research has focused on restoring this haptic information, these approaches often rely on single-modality feedback schemes which are necessary but insufficient for the feedforward and feedback control strategies employed by the central nervous system. Multi-modality feedback approaches have been gaining attention in several application domains, however, the utility for myoelectric prosthesis use remains unclear. In this study, we investigated the utility of dual-modality haptic feedback in a virtual EMG-controlled grasp-and-hold task with a brittle object and variable load force. We recruited N = 20 participants without limb difference to perform the task in four conditions: no feedback, vibration feedback of incipient slip, squeezing feedback of grip force, and dual (vibration + squeezing) feedback of incipient slip and grip force. Results suggest that receiving any haptic feedback is better than receiving none, however, dual-modality feedback is far superior to either single-modality feedback approach in terms of preventing the object from breaking or dropping. Control with dual-modality feedback was also seen as more intuitive than with either of the single-modality feedback approaches.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"16 4","pages":"816-825"},"PeriodicalIF":2.4000,"publicationDate":"2023-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Haptics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10301692/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}

引用次数: 0

Abstract

Individuals with upper-extremity limb difference who use myoelectric prostheses currently lack the haptic sensory information needed to perform dexterous activities of daily living. While considerable research has focused on restoring this haptic information, these approaches often rely on single-modality feedback schemes which are necessary but insufficient for the feedforward and feedback control strategies employed by the central nervous system. Multi-modality feedback approaches have been gaining attention in several application domains, however, the utility for myoelectric prosthesis use remains unclear. In this study, we investigated the utility of dual-modality haptic feedback in a virtual EMG-controlled grasp-and-hold task with a brittle object and variable load force. We recruited N = 20 participants without limb difference to perform the task in four conditions: no feedback, vibration feedback of incipient slip, squeezing feedback of grip force, and dual (vibration + squeezing) feedback of incipient slip and grip force. Results suggest that receiving any haptic feedback is better than receiving none, however, dual-modality feedback is far superior to either single-modality feedback approach in terms of preventing the object from breaking or dropping. Control with dual-modality feedback was also seen as more intuitive than with either of the single-modality feedback approaches.

查看原文本刊更多论文

双模态触觉反馈通过虚拟EMG控制的抓握器提高了任务执行的灵活性。

使用肌电假肢的上肢肢体有差异的个体目前缺乏进行日常生活中灵巧活动所需的触觉感觉信息。虽然相当多的研究集中在恢复这种触觉信息上，但这些方法通常依赖于单模态反馈方案，这对于中枢神经系统所采用的前馈和反馈控制策略是必要的，但并不充分。多模态反馈方法在多个应用领域得到了关注，然而，肌电假体的实用性尚不清楚。在这项研究中，我们研究了双模态触觉反馈在具有脆性物体和可变负载力的虚拟EMG控制的抓握任务中的效用。我们招募了N=20名没有肢体差异的参与者，在四种条件下执行任务：无反馈、初滑的振动反馈、握力的挤压反馈以及初滑和握力的双重（振动+挤压）反馈。结果表明，接收任何触觉反馈都比不接收要好，然而，在防止物体破碎或掉落方面，双模态反馈远优于单模态反馈方法。双模态反馈的控制也被认为比单模态反馈方法更直观。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

IEEE Transactions on Haptics COMPUTER SCIENCE, CYBERNETICS-

CiteScore

5.90

自引率

13.80%

发文量

109

审稿时长

>12 weeks

期刊介绍： IEEE Transactions on Haptics (ToH) is a scholarly archival journal that addresses the science, technology, and applications associated with information acquisition and object manipulation through touch. Haptic interactions relevant to this journal include all aspects of manual exploration and manipulation of objects by humans, machines and interactions between the two, performed in real, virtual, teleoperated or networked environments. Research areas of relevance to this publication include, but are not limited to, the following topics: Human haptic and multi-sensory perception and action, Aspects of motor control that explicitly pertain to human haptics, Haptic interactions via passive or active tools and machines, Devices that sense, enable, or create haptic interactions locally or at a distance, Haptic rendering and its association with graphic and auditory rendering in virtual reality, Algorithms, controls, and dynamics of haptic devices, users, and interactions between the two, Human-machine performance and safety with haptic feedback, Haptics in the context of human-computer interactions, Systems and networks using haptic devices and interactions, including multi-modal feedback, Application of the above, for example in areas such as education, rehabilitation, medicine, computer-aided design, skills training, computer games, driver controls, simulation, and visualization.