Roberto Meattini;Armando Amerì;Alessandra Bernardini;Javier Gonzalez-Huarte;Aitor Ibarguren;Claudio Melchiorri;Gianluca Palli
{"title":"Neuromuscular Interfacing for Advancing Kinesthetic and Teleoperated Programming by Demonstration of Collaborative Robots","authors":"Roberto Meattini;Armando Amerì;Alessandra Bernardini;Javier Gonzalez-Huarte;Aitor Ibarguren;Claudio Melchiorri;Gianluca Palli","doi":"10.1109/TOH.2024.3484373","DOIUrl":"10.1109/TOH.2024.3484373","url":null,"abstract":"This study addresses the challenges of Programming by Demonstration (PbD) in the context of collaborative robots, focusing on the need to provide additional degrees of programming without hindering the user's ability to demonstrate trajectories. The study proposes the use of a wearable human-robot interface based on surface Electromyography (sEMG) to measure the forearm's muscle co-contraction level, enabling additional programming inputs through hand stiffening level modulations without interfering with voluntary movements. Vibrotactile feedback enhances the operator's understanding of the additional programming inputs during PbD tasks. The proposed approach is demonstrated through experiments involving a collaborative robot performing an industrial wiring task. The results showcase the effectiveness and intuitiveness of the interface, allowing simultaneous programming of robot compliance and gripper grasping. The framework, applicable to both teleoperation and kinesthetic teaching, demonstrated effectively in an industrial wiring task with a 100% success rate over the group of subjects. Furthermore, the presence of vibortactile feedback showed an average decrease of programming errors of 33%, and statistical analyses confirmed the subjects' ability to correctly modulate co-contraction levels. This innovative framework augments programming by demonstration by integrating neuromuscular interfacing and introducing structured programming logics, providing an intuitive human-robot interaction for programming both gripper and compliance in teleoperation and kinesthetic teaching.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"18 1","pages":"45-57"},"PeriodicalIF":2.4,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142499447","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yuri De Pra;Vincenzo Catrambone;Virginie van Wassenhove;Alessandro Moscatelli;Gaetano Valenza;Matteo Bianchi
{"title":"Investigating the Kappa Effect Elicited Through Concurrent Visual and Tactile Stimulation","authors":"Yuri De Pra;Vincenzo Catrambone;Virginie van Wassenhove;Alessandro Moscatelli;Gaetano Valenza;Matteo Bianchi","doi":"10.1109/TOH.2024.3482570","DOIUrl":"10.1109/TOH.2024.3482570","url":null,"abstract":"The experience of time and space in subjective perception is closely connected. The Kappa effect refers to the phenomenon where the perceived duration of the time interval between stimuli is influenced by the spatial distance between them. In this study, we aimed to explore the Kappa effect from a psychophysical perspective. We investigated participants' perception of temporal duration in the sub-second range by delivering visual and tactile inputs through wearable devices placed on both the palm and the forearm. We compared the impact of unimodal sensory stimulation, involving either visual or tactile stimuli, with different bimodal stimulation conditions. Our results revealed that the illusory effect on inter-stimulus duration perception can be observed in both unimodal conditions, although the distortions were significantly more pronounced in vision. In the multimodal stimulation condition, where visual stimuli were presented at non-equidistant spatial locations, the integration of tactile input did not reduce the Kappa effect, regardless of the spatial location of the tactile stimuli. However, when the visual stimuli were equidistant in space, regardless of the spatial location of the tactile stimuli, the Kappa effect disappeared. These results can shed light on the effect played by multimodality on the perception of space and time.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 4","pages":"924-934"},"PeriodicalIF":2.4,"publicationDate":"2024-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10720910","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142464157","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Arthur Paté;Nathan Ouvrai;Quentin Consigny;Claudia Fritz
{"title":"Two Rapid Alternatives Compared to the Staircase Method for the Estimation of the Vibrotactile Perception Threshold","authors":"Arthur Paté;Nathan Ouvrai;Quentin Consigny;Claudia Fritz","doi":"10.1109/TOH.2024.3479950","DOIUrl":"10.1109/TOH.2024.3479950","url":null,"abstract":"Wearable vibrotactile devices seem now mature for entering the daily lives and practices of more and more users. However, vibrotactile perception can greatly differ between individuals, in terms of psychophysics and physiology, not to mention higher levels (cognitive or affective for example). Broadly-distributed and affordable vibrotactile devices hence must be adapted to each user's own perception, first of all by delivering intensity levels that are in the perceptible range of the user. This implies determining the user's own thresholds of perception, and then adapting the devices' output levels. Classical methods for the estimation of thresholds elicit too long procedures, and little is known about the reliability of other methods in the vibrotactile domain. This article focuses on two alternative methods for the estimation of amplitude thresholds in the vibrotactile modality (“increasing-intensity” and “decreasing-intensity” methods), and compares their estimations to the estimations from a staircase method. Both rapid methods result in much shorter test durations, and are found less stressful and tiring than the classic method, while showing threshold estimations that are never found to differ by more than 1.5 JND from the estimations by the classic method.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 4","pages":"935-945"},"PeriodicalIF":2.4,"publicationDate":"2024-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142464158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multichannel Vibrotactile Glove: Validation of a New Device Designed to Sense Vibrations","authors":"Loonan Chauvette;Éliane Leprohon;Louis-Philippe Perron-Houle;Valentin Pintat;Aidin Delnavaz;Jérémie Voix;Andréanne Sharp","doi":"10.1109/TOH.2024.3475740","DOIUrl":"10.1109/TOH.2024.3475740","url":null,"abstract":"There is a growing interest in using the tactile modality as a compensation or sensory augmentation tool in various fields. The Multichannel Vibrotactile Glove was designed to meet the needs of these diverse disciplines and overcome the limitations of current sound-to-touch technologies. Using 12 independent haptic exciters on each finger's back and on the palm, the device can convey acoustic information to cutaneous vibrotactile receptors with precise control of the location, frequency, timing, and intensity. A staircase method was used to model vibration detection thresholds at six frequencies (100, 200, 250, 500, 800, 1000 Hertz) for each actuator position (All, Thumb, Index, Major, Middle, Pinky, Palm) and both hands (Right, Left). No between hand difference was observed and all finger actuators provided consistent thresholds, except for the Palm which exhibited higher thresholds. Spatial summation effects were observed when all actuators were activated simultaneously. Detection thresholds significantly increased at 100 Hertz and above 500 Hertz. These findings confirm that the system provides uniform stimulation across hands and actuators. Overall, the Multichannel Vibrotactile Glove provides the freedom to send various acoustic features to individual actuators, providing a versatile tool for research and a potential technology to substitute, compensate, or extend sensory perception.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 4","pages":"913-923"},"PeriodicalIF":2.4,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142390216","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Passive Realizations of Series Elastic Actuation: Effects of Plant and Controller Dynamics on Haptic Rendering Performance","authors":"Celal Umut Kenanoglu;Volkan Patoglu","doi":"10.1109/TOH.2024.3470236","DOIUrl":"10.1109/TOH.2024.3470236","url":null,"abstract":"We introduce minimal passive physical realizations of series (damped) elastic actuation (S(D)EA) under closed-loop control to determine the effect of different plant parameters and controller gains on the closed-loop performance of the system and to establish an intuitive understanding of the passivity bounds. Furthermore, we explicitly derive the feasibility conditions for these passive physical equivalents and compare them to the necessary and sufficient conditions for the passivity of S(D)EA under velocity-sourced impedance control (VSIC) to establish their relationship. Through the passive physical equivalents, we rigorously compare the effect of different plant dynamics (e.g., SEA and SDEA) on the system performance. We demonstrate that passive physical equivalents make the effect of controller gains explicit and establish a natural means for effective impedance analysis. We also show that passive physical equivalents promote co-design thinking by enforcing simultaneous and unbiased consideration of (possibly negative) controller gains and plant parameters. We demonstrate the usefulness of negative controller gains when coupled with properly designed plant dynamics. Finally, we provide experimental validations of our theoretical passivity results and comprehensive characterizations of the haptic rendering performance of S(D)EA under VSIC.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 4","pages":"882-899"},"PeriodicalIF":2.4,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142345807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Peiliang Wu, Haozhe Zhang, Yao Li, Wenbai Chen, Guowei Gao
{"title":"VT-SGN:Spiking Graph Neural Network for Neuromorphic Visual-Tactile Fusion.","authors":"Peiliang Wu, Haozhe Zhang, Yao Li, Wenbai Chen, Guowei Gao","doi":"10.1109/TOH.2024.3449411","DOIUrl":"https://doi.org/10.1109/TOH.2024.3449411","url":null,"abstract":"<p><p>Current issues with neuromorphic visual-tactile perception include limited training network representation and inadequate cross-modal fusion. To address these two issues, we proposed a dual network called visual-tactile spiking graph neural network (VT-SGN) that combines graph neural networks and spiking neural networks to jointly utilize the neuromorphic visual and tactile source data. First, the neuromorphic visual-tactile data were expanded spatiotemporally to create a taxel-based tactile graph in the spatial domain, enabling the complete exploitation of the irregular spatial structure properties of tactile information. Subsequently, a method for converting images into graph structures was proposed, allowing the vision to be trained alongside graph neural networks and extracting graph-level features from the vision for fusion with tactile data. Finally, the data were expanded into the time domain using a spiking neural network to train the model and propagate it backwards. This framework effectively utilizes the structural differences between sample instances in the spatial dimension to improve the representational power of spiking neurons, while preserving the biodynamic mechanism of the spiking neural network. Additionally, it effectively solves the morphological variance between the two perceptions and further uses complementary data between visual and tactile. To demonstrate that our approach can improve the learning of neuromorphic perceptual information, we conducted comprehensive comparative experiments on three datasets to validate the benefits of the proposed VT-SGN framework by comparing it with state-of-the-art studies.</p>","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"PP ","pages":""},"PeriodicalIF":2.4,"publicationDate":"2024-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142345811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Takuya Jodai;Lynette A. Jones;Masahiko Terao;Hsin-Ni Ho
{"title":"Perceiving Synchrony: Determining Thermal-Tactile Simultaneity Windows","authors":"Takuya Jodai;Lynette A. Jones;Masahiko Terao;Hsin-Ni Ho","doi":"10.1109/TOH.2024.3452102","DOIUrl":"10.1109/TOH.2024.3452102","url":null,"abstract":"In cutaneous displays in which both tactile and thermal signals are presented, it is important to understand the temporal requirements associated with presenting these signals so that they are perceptually synchronous. Such synchrony is important to provide realistic touch experiences in applications involving object recognition and social touch interactions. In the present experiment the temporal window within which tactile and warm thermal stimuli are perceived to occur at the same time was determined. A Simultaneity Judgment Task was used in which pairs of tactile and thermal stimuli were presented on the hand at varying stimulus onset asynchronies, and participants determined whether the stimuli were simultaneous or not. The results indicated that the average simultaneity window width was 1041 ms. The average point of subjective simultaneity (PSS) was −569 ms, indicating that participants perceived simultaneity best when the warm thermal stimulus preceded the tactile stimulus by 569 ms. These findings indicate that thermal and tactile stimuli do not need to be displayed simultaneously for the two stimuli to be perceived as being synchronous and therefore the timing of such stimuli can be adjusted to maximize the likelihood that they will both be perceived.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 4","pages":"850-859"},"PeriodicalIF":2.4,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10663949","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142125601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rubén Martín-Rodríguez;Alexandre L. Ratschat;Laura Marchal-Crespo;Yasemin Vardar
{"title":"Tactile Weight Rendering: A Review for Researchers and Developers","authors":"Rubén Martín-Rodríguez;Alexandre L. Ratschat;Laura Marchal-Crespo;Yasemin Vardar","doi":"10.1109/TOH.2024.3453894","DOIUrl":"10.1109/TOH.2024.3453894","url":null,"abstract":"Haptic rendering of weight plays an essential role in naturalistic object interaction in virtual environments. While kinesthetic devices have traditionally been used for this aim by applying forces on the limbs, tactile interfaces acting on the skin have recently offered potential solutions to enhance or substitute kinesthetic ones. Here, we aim to provide an in-depth overview and comparison of existing tactile weight rendering approaches. We categorized these approaches based on their type of stimulation into asymmetric vibration and skin stretch, further divided according to the working mechanism of the devices. Then, we compared these approaches using various criteria, including physical, mechanical, and perceptual characteristics of the reported devices. We found that asymmetric vibration devices have the smallest form factor, while skin stretch devices relying on the motion of flat surfaces, belts, or tactors present numerous mechanical and perceptual advantages for scenarios requiring more accurate weight rendering. Finally, we discussed the selection of the proposed categorization of devices together with the limitations and opportunities for future research. We hope this study guides the development and use of tactile interfaces to achieve a more naturalistic object interaction and manipulation in virtual environments.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"18 1","pages":"93-109"},"PeriodicalIF":2.4,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10663833","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142125602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ge Shi;Jialei Shi;Azadeh Shariati;Kamyar Motaghedolhagh;Shervanthi Homer-Vanniasinkam;Helge A. Wurdemann
{"title":"Design and Characterization of Multi-Cavity, Fluidic Haptic Feedback System for Mechano-Tactile Feedback","authors":"Ge Shi;Jialei Shi;Azadeh Shariati;Kamyar Motaghedolhagh;Shervanthi Homer-Vanniasinkam;Helge A. Wurdemann","doi":"10.1109/TOH.2024.3454179","DOIUrl":"10.1109/TOH.2024.3454179","url":null,"abstract":"Numerous studies have indicated that the use of a closed-loop haptic feedback system, which offers various mechano-tactile stimuli patterns with different actuation methods, can improve the performance and grasp control of prosthetic hands. Purely mechanical-driven feedback approaches for various mechano-tactile stimuli patterns, however, have not been explored. In this paper, a multi-cavity fluidic haptic feedback system is introduced with details of design, fabrication, and validation. The multi-cavity haptic feedback system can detect the physical touch with direction at the fingertip sensor. The direction of the force is reflected in the form of pressure deviation in the multi-cavity fingertip sensor. The feedback actuator generates various mechano-tactile stimuli patterns according to the pressure deviation from the fingertip sensor. Hence, users can identify the force with direction according to the stimuli patterns. The haptic feedback system is validated through two experiments. The initial experiment characterises the system and establishes the relationship between the fingertip sensor and feedback actuator. The subsequent experiment, a human interaction test, confirms the system's capability to detect force with directions and generate corresponding tactile stimuli in the feedback actuator. The outcomes corroborate the idea that participants are generally capable of discerning changes in angle.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"18 1","pages":"6-19"},"PeriodicalIF":2.4,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142125600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Effect of Finger Moisture on Tactile Perception of Electroadhesion","authors":"Easa AliAbbasi;Muhammad Muzammil;Omer Sirin;Philippe Lefèvre;Ørjan Grøttem Martinsen;Cagatay Basdogan","doi":"10.1109/TOH.2024.3441670","DOIUrl":"10.1109/TOH.2024.3441670","url":null,"abstract":"We investigate the effect of finger moisture on the tactile perception of electroadhesion with 10 participants. Participants with moist fingers exhibited markedly higher threshold levels. Our electrical impedance measurements show a substantial reduction in impedance magnitude when sweat is present at the finger-touchscreen interface, indicating increased conductivity. Supporting this, our mechanical friction measurements show that the relative increase in electrostatic force due to electroadhesion is lower for a moist finger.","PeriodicalId":13215,"journal":{"name":"IEEE Transactions on Haptics","volume":"17 4","pages":"841-849"},"PeriodicalIF":2.4,"publicationDate":"2024-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141987852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}