Srinidhi Madhyastha, R. Girishu, M. Varuna, G. PoornimaB.
{"title":"手语到文本和语音的转换以及手势的预测","authors":"Srinidhi Madhyastha, R. Girishu, M. Varuna, G. PoornimaB.","doi":"10.35940/ijrte.f9502.038620","DOIUrl":null,"url":null,"abstract":"Deaf people rely on sign language to express their own thoughts and feelings. It becomes the major communication barrier between the deaf and other people. Sign Language has evolved as one of the major areas of research and study in computer vision. Researchers in sign language recognition used different input devices such as data gloves, web camera, depth camera, color camera, Microsoft's Kinect sensor, etc. to capture hand signs. In this paper, we display the importance of Sign Language and proposed technique for classification and their efficient results. A sign language looks up the manual communication and body language to convey meaning, as opposed to acoustically conveyed sound patterns, which involve a simultaneous combination of hand shapes, orientation, and movement of hands. The signs are captured using a new digital sensor called “Leap Motion Controller”. LMC is 3D non-contact motion sensor which can track and detects hands, fingers, bones and finger-like objects. The Leap device tracks the data like point, wave, reach, grab which is generated by a leap motion controller. The system implements Dynamic Time Warping (DTW) for converting the hand gestures into an appropriate text.","PeriodicalId":13801,"journal":{"name":"International Journal for Advance Research and Development","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2017-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Conversion of Sign Language to Text and Speech and Prediction of Gesture\",\"authors\":\"Srinidhi Madhyastha, R. Girishu, M. Varuna, G. PoornimaB.\",\"doi\":\"10.35940/ijrte.f9502.038620\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Deaf people rely on sign language to express their own thoughts and feelings. It becomes the major communication barrier between the deaf and other people. Sign Language has evolved as one of the major areas of research and study in computer vision. Researchers in sign language recognition used different input devices such as data gloves, web camera, depth camera, color camera, Microsoft's Kinect sensor, etc. to capture hand signs. In this paper, we display the importance of Sign Language and proposed technique for classification and their efficient results. A sign language looks up the manual communication and body language to convey meaning, as opposed to acoustically conveyed sound patterns, which involve a simultaneous combination of hand shapes, orientation, and movement of hands. The signs are captured using a new digital sensor called “Leap Motion Controller”. LMC is 3D non-contact motion sensor which can track and detects hands, fingers, bones and finger-like objects. The Leap device tracks the data like point, wave, reach, grab which is generated by a leap motion controller. The system implements Dynamic Time Warping (DTW) for converting the hand gestures into an appropriate text.\",\"PeriodicalId\":13801,\"journal\":{\"name\":\"International Journal for Advance Research and Development\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2017-03-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal for Advance Research and Development\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.35940/ijrte.f9502.038620\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal for Advance Research and Development","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.35940/ijrte.f9502.038620","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Conversion of Sign Language to Text and Speech and Prediction of Gesture
Deaf people rely on sign language to express their own thoughts and feelings. It becomes the major communication barrier between the deaf and other people. Sign Language has evolved as one of the major areas of research and study in computer vision. Researchers in sign language recognition used different input devices such as data gloves, web camera, depth camera, color camera, Microsoft's Kinect sensor, etc. to capture hand signs. In this paper, we display the importance of Sign Language and proposed technique for classification and their efficient results. A sign language looks up the manual communication and body language to convey meaning, as opposed to acoustically conveyed sound patterns, which involve a simultaneous combination of hand shapes, orientation, and movement of hands. The signs are captured using a new digital sensor called “Leap Motion Controller”. LMC is 3D non-contact motion sensor which can track and detects hands, fingers, bones and finger-like objects. The Leap device tracks the data like point, wave, reach, grab which is generated by a leap motion controller. The system implements Dynamic Time Warping (DTW) for converting the hand gestures into an appropriate text.