Realizing Mixed Reality through Mobile Systems Research

Abstract

The emergence of mobile mixed reality (MR) and augmented reality (AR) frameworks portends a future of computational immersion, placing virtual objects amidst physical environments. As MR and AR become increasingly accessible and programmable, immersive media experiences will enhance education, training, navigation, productivity, cultural exhibits. However, to sustain MR and AR use cases, mobile systems will be challenged with system bottlenecks to energy efficiency, computational performance, device security, and user privacy. These bottlenecks stem from the visual sensing needs and graphics-intensive workloads that power MR and AR. Properly contextualized and adjusted, a variety of prior mobile systems research projects can find relevance in these emerging paradigms, leveraging continuous mobile vision, edge computing, mobile graphics processing, etc. Further advances can come from future mobile systems research projects. Together, the mobile systems research community can realize these immersive paradigms in our future mobile devices.