Incorporating AR into a Multimodal UI for an Artificial Pancreas: The interdisciplinary nature of integrating augmented reality (AR), sound, and touch into a user interface (UI) for diabetes patients with embedded control systems for an artificial pancreas (AP)

Abstract

This paper explores the emerging field of human-embedded medical technology and its accompanying need for innovative user experience (UX) design. Specifically, the paper argues that, in the medium term, augmented reality (AR) can effectively serve as one part of a multimodal user interface (UI) for diabetes patients with embedded control systems for an artificial pancreas (AP). The paper explores what types of cross-disciplinary information UX designers will need in order to incorporate AR into an effective multimodal interface for diabetes patients with an AP. Currently, researchers are developing methods to embed continuous glucose monitors (CGM), model predictive control (MPC) systems, and AP systems into diabetes patients to regulate their blood sugar levels [30]. Ideally, an embedded control in a wearable medical device would remove the need for users to interact with the system because the system would self-regulate. However, once embedded, not only will a physician/technician need to initialize and adjust the system, but, ethically and practically, patients will also need access to the system. In the medium-term future (5-10 years), AR-with its emphasis on cross-disciplinary design needs-shows promise for conveying visual information most effectively to the patient. This paper addresses the interdisciplinary nature of conveying user information for embedded medical devices because it demonstrates the need for UX designers to integrate recent advancements in healthcare research, medical technology, cross-disciplinary design theory (e.g. human factors and effective use theory), and the rapidly changing nature of human-computer interaction (HCI).