Voice-Enabled Blockly: Usability Impressions of a Speech-driven Block-based Programming System

Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility Pub Date : 2022-10-22 DOI:10.1145/3517428.3550382

Obianuju Okafor, S. Ludi

{"title":"Voice-Enabled Blockly: Usability Impressions of a Speech-driven Block-based Programming System","authors":"Obianuju Okafor, S. Ludi","doi":"10.1145/3517428.3550382","DOIUrl":null,"url":null,"abstract":"Block-based programming environments pose a challenge for people with upper-limb motor impairments. This is because they are highly dependent on the physical manipulation of a mouse or keyboard to drag and drop elements on the screen. Our research aims to make the block-based programming environment Blockly, accessible to users with upper limb motor impairments by adding voice as an alternative input modality. This voice-enabled version of Blockly will reduce the need for the use of a pointing device, thus increasing access for people with limited dexterity. The Voice-enabled Blockly system consists of the Blockly application, a speech recognition API, predefined voice commands, and a custom function. A usability study was conducted using a prototype of Voice-enabled Blockly. The results revealed that people with upper-limb motor impairments can use the system. However, it also exposed some shortcomings of the tool and gave some suggestions on how to fix them. Based on the findings, changes will be made to the system, and then, it will be evaluated in another user study in the near future.","PeriodicalId":384752,"journal":{"name":"Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility","volume":"95 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3517428.3550382","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 1

Abstract

Block-based programming environments pose a challenge for people with upper-limb motor impairments. This is because they are highly dependent on the physical manipulation of a mouse or keyboard to drag and drop elements on the screen. Our research aims to make the block-based programming environment Blockly, accessible to users with upper limb motor impairments by adding voice as an alternative input modality. This voice-enabled version of Blockly will reduce the need for the use of a pointing device, thus increasing access for people with limited dexterity. The Voice-enabled Blockly system consists of the Blockly application, a speech recognition API, predefined voice commands, and a custom function. A usability study was conducted using a prototype of Voice-enabled Blockly. The results revealed that people with upper-limb motor impairments can use the system. However, it also exposed some shortcomings of the tool and gave some suggestions on how to fix them. Based on the findings, changes will be made to the system, and then, it will be evaluated in another user study in the near future.

查看原文本刊更多论文

语音支持的块:语音驱动的基于块的编程系统的可用性印象

基于块的编程环境对上肢运动障碍患者提出了挑战。这是因为它们高度依赖于鼠标或键盘在屏幕上拖放元素的物理操作。我们的研究旨在通过添加语音作为另一种输入方式，使基于块的编程环境Blockly对上肢运动障碍的用户可用。这个语音版本的Blockly将减少使用指向设备的需要，从而增加了灵巧度有限的人的访问。支持语音的Blockly系统由Blockly应用程序、语音识别API、预定义语音命令和自定义功能组成。一项可用性研究是使用语音支持的block原型进行的。结果显示，上肢运动障碍患者可以使用该系统。然而，它也暴露了该工具的一些缺点，并就如何修复这些缺点提出了一些建议。根据调查结果，将对系统进行更改，然后，将在不久的将来在另一项用户研究中对其进行评估。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility

自引率

0.00%

发文量