Avish Kabra, Chandan Agrawal, H. Pallab Jyoti Dutta, M. Bhuyan, R. Laskar
{"title":"基于视觉的通信器","authors":"Avish Kabra, Chandan Agrawal, H. Pallab Jyoti Dutta, M. Bhuyan, R. Laskar","doi":"10.1109/ASPCON49795.2020.9276664","DOIUrl":null,"url":null,"abstract":"This work provides a vision-based human-computer interface. The interface senses and interprets eye-blinks as controls along with gaze detection methods. We used image processing methods like haar-like features for automatic face detection, followed by eye tracking and blink detection based on landmarks. The gaze detection mechanism helps in easy controlling of the mouse pointer which can help people with disabilities to communicate effectively. A heatmap is also generated so that in future developments, this data can be used to design a more efficient layout for the controls. Given the necessity to move towards online solutions, such data can cater to the needs of a variety of sectors.","PeriodicalId":193814,"journal":{"name":"2020 IEEE Applied Signal Processing Conference (ASPCON)","volume":"40 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Vision Based Communicator\",\"authors\":\"Avish Kabra, Chandan Agrawal, H. Pallab Jyoti Dutta, M. Bhuyan, R. Laskar\",\"doi\":\"10.1109/ASPCON49795.2020.9276664\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This work provides a vision-based human-computer interface. The interface senses and interprets eye-blinks as controls along with gaze detection methods. We used image processing methods like haar-like features for automatic face detection, followed by eye tracking and blink detection based on landmarks. The gaze detection mechanism helps in easy controlling of the mouse pointer which can help people with disabilities to communicate effectively. A heatmap is also generated so that in future developments, this data can be used to design a more efficient layout for the controls. Given the necessity to move towards online solutions, such data can cater to the needs of a variety of sectors.\",\"PeriodicalId\":193814,\"journal\":{\"name\":\"2020 IEEE Applied Signal Processing Conference (ASPCON)\",\"volume\":\"40 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-10-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE Applied Signal Processing Conference (ASPCON)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ASPCON49795.2020.9276664\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE Applied Signal Processing Conference (ASPCON)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ASPCON49795.2020.9276664","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
This work provides a vision-based human-computer interface. The interface senses and interprets eye-blinks as controls along with gaze detection methods. We used image processing methods like haar-like features for automatic face detection, followed by eye tracking and blink detection based on landmarks. The gaze detection mechanism helps in easy controlling of the mouse pointer which can help people with disabilities to communicate effectively. A heatmap is also generated so that in future developments, this data can be used to design a more efficient layout for the controls. Given the necessity to move towards online solutions, such data can cater to the needs of a variety of sectors.