Omer Ben Barak-Dror, Barak Hadad, Hani Barhum, David Haggiag, Michal Tepper, Israel Gannot, Yuval Nir
{"title":"Touchless short-wave infrared imaging for dynamic rapid pupillometry and gaze estimation in closed eyes","authors":"Omer Ben Barak-Dror, Barak Hadad, Hani Barhum, David Haggiag, Michal Tepper, Israel Gannot, Yuval Nir","doi":"10.1038/s43856-024-00572-1","DOIUrl":null,"url":null,"abstract":"Assessments of gaze direction (eye movements), pupil size, and the pupillary light reflex (PLR) are critical for neurological examination and neuroscience research and constitute a powerful tool in diverse clinical settings ranging from critical care through endocrinology and drug addiction to cardiology and psychiatry. However, current bedside pupillometry is typically intermittent, qualitative, manual, and limited to open-eye cases, restricting its use in sleep medicine, anesthesia, and intensive care. We combined short-wave infrared (SWIR, ~0.9-1.7μm) imaging with image processing algorithms to perform rapid (~30 ms) pupillometry and eye tracking behind closed eyelids. Forty-three healthy volunteers participated in two experiments with PLR evoked by visible light stimuli or directing eye movements towards screen targets. Imaging was performed simultaneously on one eye closed, and the other open eye serving as ground truth. Data analysis was performed with a custom approach quantifying changes in brightness around the pupil area or with a deep learning U-NET-based procedure. Here we show that analysis of SWIR imaging data can successfully measure stimulus-evoked PLR in closed-eye conditions, revealing PLR events in single trials and significant PLRs in nearly all individual subjects, as well as estimating gaze direction. The neural net-based analysis could successfully use closed-eye SWIR data to recreate estimates of open-eye images and assess pupil size. Continuous touchless monitoring of rapid dynamics in pupil size and gaze direction through closed eyes paves the way for developing devices with wide-ranging applications, fulfilling long-standing goals in clinical and research fields. Monitoring eye movements and pupil size is important for both clinical assessments and in biomedical research. However, measurements are usually made on open eyes. We developed a method that continuously monitors pupil size when eyes are closed and compared it to results obtained when eyes are open. Our approach is contactless and can measure pupil size and gaze direction for hours. This approach has many potential clinical and research uses. For example, it could be used to monitor the extent of arousal during and following anesthesia, sleep, and in unconscious patients. Ben Barak-Dror et al. present a short-wave infrared imaging method for touchless monitoring of pupillary light reflex (PLR) and gaze direction in closed eyes. Data obtained is comparable to that obtained from open eyes.","PeriodicalId":72646,"journal":{"name":"Communications medicine","volume":null,"pages":null},"PeriodicalIF":5.4000,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11303404/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Communications medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.nature.com/articles/s43856-024-00572-1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, RESEARCH & EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0
Abstract
Assessments of gaze direction (eye movements), pupil size, and the pupillary light reflex (PLR) are critical for neurological examination and neuroscience research and constitute a powerful tool in diverse clinical settings ranging from critical care through endocrinology and drug addiction to cardiology and psychiatry. However, current bedside pupillometry is typically intermittent, qualitative, manual, and limited to open-eye cases, restricting its use in sleep medicine, anesthesia, and intensive care. We combined short-wave infrared (SWIR, ~0.9-1.7μm) imaging with image processing algorithms to perform rapid (~30 ms) pupillometry and eye tracking behind closed eyelids. Forty-three healthy volunteers participated in two experiments with PLR evoked by visible light stimuli or directing eye movements towards screen targets. Imaging was performed simultaneously on one eye closed, and the other open eye serving as ground truth. Data analysis was performed with a custom approach quantifying changes in brightness around the pupil area or with a deep learning U-NET-based procedure. Here we show that analysis of SWIR imaging data can successfully measure stimulus-evoked PLR in closed-eye conditions, revealing PLR events in single trials and significant PLRs in nearly all individual subjects, as well as estimating gaze direction. The neural net-based analysis could successfully use closed-eye SWIR data to recreate estimates of open-eye images and assess pupil size. Continuous touchless monitoring of rapid dynamics in pupil size and gaze direction through closed eyes paves the way for developing devices with wide-ranging applications, fulfilling long-standing goals in clinical and research fields. Monitoring eye movements and pupil size is important for both clinical assessments and in biomedical research. However, measurements are usually made on open eyes. We developed a method that continuously monitors pupil size when eyes are closed and compared it to results obtained when eyes are open. Our approach is contactless and can measure pupil size and gaze direction for hours. This approach has many potential clinical and research uses. For example, it could be used to monitor the extent of arousal during and following anesthesia, sleep, and in unconscious patients. Ben Barak-Dror et al. present a short-wave infrared imaging method for touchless monitoring of pupillary light reflex (PLR) and gaze direction in closed eyes. Data obtained is comparable to that obtained from open eyes.