mobileVision: A Face-mounted, Voice-activated, Non-mydriatic "Lucky" Ophthalmoscope

We present mobileVision -- a portable, robust, smartphone-based ophthalmoscopy prototype intended to reduce the barriers to ocular pathology screening in developing and underserved regions. In contrast to currently available retinal imaging solutions, mobileVision provides the portability of a handheld ophthalmoscope without sacrificing retinal field-of-view or resolution. Through tight integration with a smartphone and ergonomic design, we demonstrate novel features for such a small form factor, including: automatic compensation for patient refractive error, voice-activated multi-shot retinal image acquisition without pupil dilation (non-mydriatic), and touch-gesture based control of patient fixation and accommodation. We further demonstrate a computational lucky imaging and retinal stitching pipeline which not only increases overall retinal field-of-view, but also makes the system robust to patient saccades, blinks, device jitter, and imaging artifacts such as noise or unintended scattering from ocular surfaces. We estimate through mock eye tests that the mobileVision prototype is capable of imaging the retina with 23.5μm of retinal resolution for patients with between −6 D to +13 D refractive error, and we image over ±45° of retina during an in vivo trial.