A Framework for Supporting Deaf and Mute Learning Experience Through Extended Reality

Abstract

Deaf and mute people do not have similar capabilities of learning experience with normal people. They find difficulties to absorb and understand the learning content. To date, XR technology has shown promising and significant impact in supporting teaching and learning specifically for disabilities people. This concept paper will propose a framework for deaf and mute learners as to enhance their learning experience by utilizing XR technology such as VR, AR and MR. Begin with user requirement analysis, a prototype will be developed based on the proposed framework and followed by evaluation phase. Most of the framework focusing on single approach of technology. Thus, our concern is to look at how XR would be capable to assist and support deaf and mute learners for their learning experience. The future work would be completing the XR prototype and evaluation to ensure the proposed framework is significant and useful in teaching and learning environment.