{"title":"触觉音调系统:一种可穿戴设备,以协助人工耳蜗使用者的音高准确性","authors":"Sungyong Shin, Changmok Oh, Hyungcheol Shin","doi":"10.1145/3373625.3418008","DOIUrl":null,"url":null,"abstract":"Cochlear implantation is an effective tool in speech perception. However, activities such as listening to music and singing remain challenging for cochlear implant (CI) users, due to inaccurate pitch recognition. In this study, we propose a method for CI users to recognize precise pitch differences through tactile feedback. The proposed system encodes real-time audio signals to 36 musical tones (from C3 to B5), represented by tactile codes using nine vibration motors in a glove-type device. Two CI users participated in 15 h of training using our system and showed significant improvement in pitch accuracy while singing. In addition to the quantitative results, both participants expressed satisfaction in distinguishing and vocalizing musical tones, which led to increased interest in music. This study provides opportunities for CI users to engage more deeply and participate in musical education as well as achieve improved aural rehabilitation.","PeriodicalId":433618,"journal":{"name":"Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Tactile Tone System: A Wearable Device to Assist Accuracy of Vocal Pitch in Cochlear Implant Users\",\"authors\":\"Sungyong Shin, Changmok Oh, Hyungcheol Shin\",\"doi\":\"10.1145/3373625.3418008\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Cochlear implantation is an effective tool in speech perception. However, activities such as listening to music and singing remain challenging for cochlear implant (CI) users, due to inaccurate pitch recognition. In this study, we propose a method for CI users to recognize precise pitch differences through tactile feedback. The proposed system encodes real-time audio signals to 36 musical tones (from C3 to B5), represented by tactile codes using nine vibration motors in a glove-type device. Two CI users participated in 15 h of training using our system and showed significant improvement in pitch accuracy while singing. In addition to the quantitative results, both participants expressed satisfaction in distinguishing and vocalizing musical tones, which led to increased interest in music. This study provides opportunities for CI users to engage more deeply and participate in musical education as well as achieve improved aural rehabilitation.\",\"PeriodicalId\":433618,\"journal\":{\"name\":\"Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-10-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3373625.3418008\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3373625.3418008","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Tactile Tone System: A Wearable Device to Assist Accuracy of Vocal Pitch in Cochlear Implant Users
Cochlear implantation is an effective tool in speech perception. However, activities such as listening to music and singing remain challenging for cochlear implant (CI) users, due to inaccurate pitch recognition. In this study, we propose a method for CI users to recognize precise pitch differences through tactile feedback. The proposed system encodes real-time audio signals to 36 musical tones (from C3 to B5), represented by tactile codes using nine vibration motors in a glove-type device. Two CI users participated in 15 h of training using our system and showed significant improvement in pitch accuracy while singing. In addition to the quantitative results, both participants expressed satisfaction in distinguishing and vocalizing musical tones, which led to increased interest in music. This study provides opportunities for CI users to engage more deeply and participate in musical education as well as achieve improved aural rehabilitation.