A. Maxin, Do H Lim, Sophie Kush, Jack Carpenter, Rami Shaibani, Bernice G Gulek, Kimberly G. Harmon, A. Mariakakis, Lynn B McGrath, Michael R. Levitt
{"title":"智能手机瞳孔测量和机器学习用于检测急性轻度创伤性脑损伤:队列研究","authors":"A. Maxin, Do H Lim, Sophie Kush, Jack Carpenter, Rami Shaibani, Bernice G Gulek, Kimberly G. Harmon, A. Mariakakis, Lynn B McGrath, Michael R. Levitt","doi":"10.2196/58398","DOIUrl":null,"url":null,"abstract":"\n \n Quantitative pupillometry is used in mild traumatic brain injury (mTBI) with changes in pupil reactivity noted after blast injury, chronic mTBI, and sports-related concussion.\n \n \n \n We evaluated the diagnostic capabilities of a smartphone-based digital pupillometer to differentiate patients with mTBI in the emergency department from controls.\n \n \n \n Adult patients diagnosed with acute mTBI with normal neuroimaging were evaluated in an emergency department within 36 hours of injury (control group: healthy adults). The PupilScreen smartphone pupillometer was used to measure the pupillary light reflex (PLR), and quantitative curve morphological parameters of the PLR were compared between mTBI and healthy controls. To address the class imbalance in our sample, a synthetic minority oversampling technique was applied. All possible combinations of PLR parameters produced by the smartphone pupillometer were then applied as features to 4 binary classification machine learning algorithms: random forest, k-nearest neighbors, support vector machine, and logistic regression. A 10-fold cross-validation technique stratified by cohort was used to produce accuracy, sensitivity, specificity, area under the curve, and F1-score metrics for the classification of mTBI versus healthy participants.\n \n \n \n Of 12 patients with acute mTBI, 33% (4/12) were female (mean age 54.1, SD 22.2 years), and 58% (7/12) were White with a median Glasgow Coma Scale (GCS) of 15. Of the 132 healthy patients, 67% (88/132) were female, with a mean age of 36 (SD 10.2) years and 64% (84/132) were White with a median GCS of 15. Significant differences were observed in PLR recordings between healthy controls and patients with acute mTBI in the PLR parameters, that are (1) percent change (mean 34%, SD 8.3% vs mean 26%, SD 7.9%; P<.001), (2) minimum pupillary diameter (mean 34.8, SD 6.1 pixels vs mean 29.7, SD 6.1 pixels; P=.004), (3) maximum pupillary diameter (mean 53.6, SD 12.4 pixels vs mean 40.9, SD 11.9 pixels; P<.001), and (4) mean constriction velocity (mean 11.5, SD 5.0 pixels/second vs mean 6.8, SD 3.0 pixels/second; P<.001) between cohorts. After the synthetic minority oversampling technique, both cohorts had a sample size of 132 recordings. The best-performing binary classification model was a random forest model using the PLR parameters of latency, percent change, maximum diameter, minimum diameter, mean constriction velocity, and maximum constriction velocity as features. This model produced an overall accuracy of 93.5%, sensitivity of 96.2%, specificity of 90.9%, area under the curve of 0.936, and F1-score of 93.7% for differentiating between pupillary changes in mTBI and healthy participants. The absolute values are unable to be provided for the performance percentages reported here due to the mechanism of 10-fold cross validation that was used to obtain them.\n \n \n \n In this pilot study, quantitative smartphone pupillometry demonstrates the potential to be a useful tool in the future diagnosis of acute mTBI.\n","PeriodicalId":73555,"journal":{"name":"JMIR neurotechnology","volume":"48 2","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Smartphone Pupillometry and Machine Learning for Detection of Acute Mild Traumatic Brain Injury: Cohort Study\",\"authors\":\"A. Maxin, Do H Lim, Sophie Kush, Jack Carpenter, Rami Shaibani, Bernice G Gulek, Kimberly G. Harmon, A. Mariakakis, Lynn B McGrath, Michael R. Levitt\",\"doi\":\"10.2196/58398\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n \\n Quantitative pupillometry is used in mild traumatic brain injury (mTBI) with changes in pupil reactivity noted after blast injury, chronic mTBI, and sports-related concussion.\\n \\n \\n \\n We evaluated the diagnostic capabilities of a smartphone-based digital pupillometer to differentiate patients with mTBI in the emergency department from controls.\\n \\n \\n \\n Adult patients diagnosed with acute mTBI with normal neuroimaging were evaluated in an emergency department within 36 hours of injury (control group: healthy adults). The PupilScreen smartphone pupillometer was used to measure the pupillary light reflex (PLR), and quantitative curve morphological parameters of the PLR were compared between mTBI and healthy controls. To address the class imbalance in our sample, a synthetic minority oversampling technique was applied. All possible combinations of PLR parameters produced by the smartphone pupillometer were then applied as features to 4 binary classification machine learning algorithms: random forest, k-nearest neighbors, support vector machine, and logistic regression. A 10-fold cross-validation technique stratified by cohort was used to produce accuracy, sensitivity, specificity, area under the curve, and F1-score metrics for the classification of mTBI versus healthy participants.\\n \\n \\n \\n Of 12 patients with acute mTBI, 33% (4/12) were female (mean age 54.1, SD 22.2 years), and 58% (7/12) were White with a median Glasgow Coma Scale (GCS) of 15. Of the 132 healthy patients, 67% (88/132) were female, with a mean age of 36 (SD 10.2) years and 64% (84/132) were White with a median GCS of 15. Significant differences were observed in PLR recordings between healthy controls and patients with acute mTBI in the PLR parameters, that are (1) percent change (mean 34%, SD 8.3% vs mean 26%, SD 7.9%; P<.001), (2) minimum pupillary diameter (mean 34.8, SD 6.1 pixels vs mean 29.7, SD 6.1 pixels; P=.004), (3) maximum pupillary diameter (mean 53.6, SD 12.4 pixels vs mean 40.9, SD 11.9 pixels; P<.001), and (4) mean constriction velocity (mean 11.5, SD 5.0 pixels/second vs mean 6.8, SD 3.0 pixels/second; P<.001) between cohorts. After the synthetic minority oversampling technique, both cohorts had a sample size of 132 recordings. The best-performing binary classification model was a random forest model using the PLR parameters of latency, percent change, maximum diameter, minimum diameter, mean constriction velocity, and maximum constriction velocity as features. This model produced an overall accuracy of 93.5%, sensitivity of 96.2%, specificity of 90.9%, area under the curve of 0.936, and F1-score of 93.7% for differentiating between pupillary changes in mTBI and healthy participants. The absolute values are unable to be provided for the performance percentages reported here due to the mechanism of 10-fold cross validation that was used to obtain them.\\n \\n \\n \\n In this pilot study, quantitative smartphone pupillometry demonstrates the potential to be a useful tool in the future diagnosis of acute mTBI.\\n\",\"PeriodicalId\":73555,\"journal\":{\"name\":\"JMIR neurotechnology\",\"volume\":\"48 2\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JMIR neurotechnology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2196/58398\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR neurotechnology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/58398","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Smartphone Pupillometry and Machine Learning for Detection of Acute Mild Traumatic Brain Injury: Cohort Study
Quantitative pupillometry is used in mild traumatic brain injury (mTBI) with changes in pupil reactivity noted after blast injury, chronic mTBI, and sports-related concussion.
We evaluated the diagnostic capabilities of a smartphone-based digital pupillometer to differentiate patients with mTBI in the emergency department from controls.
Adult patients diagnosed with acute mTBI with normal neuroimaging were evaluated in an emergency department within 36 hours of injury (control group: healthy adults). The PupilScreen smartphone pupillometer was used to measure the pupillary light reflex (PLR), and quantitative curve morphological parameters of the PLR were compared between mTBI and healthy controls. To address the class imbalance in our sample, a synthetic minority oversampling technique was applied. All possible combinations of PLR parameters produced by the smartphone pupillometer were then applied as features to 4 binary classification machine learning algorithms: random forest, k-nearest neighbors, support vector machine, and logistic regression. A 10-fold cross-validation technique stratified by cohort was used to produce accuracy, sensitivity, specificity, area under the curve, and F1-score metrics for the classification of mTBI versus healthy participants.
Of 12 patients with acute mTBI, 33% (4/12) were female (mean age 54.1, SD 22.2 years), and 58% (7/12) were White with a median Glasgow Coma Scale (GCS) of 15. Of the 132 healthy patients, 67% (88/132) were female, with a mean age of 36 (SD 10.2) years and 64% (84/132) were White with a median GCS of 15. Significant differences were observed in PLR recordings between healthy controls and patients with acute mTBI in the PLR parameters, that are (1) percent change (mean 34%, SD 8.3% vs mean 26%, SD 7.9%; P<.001), (2) minimum pupillary diameter (mean 34.8, SD 6.1 pixels vs mean 29.7, SD 6.1 pixels; P=.004), (3) maximum pupillary diameter (mean 53.6, SD 12.4 pixels vs mean 40.9, SD 11.9 pixels; P<.001), and (4) mean constriction velocity (mean 11.5, SD 5.0 pixels/second vs mean 6.8, SD 3.0 pixels/second; P<.001) between cohorts. After the synthetic minority oversampling technique, both cohorts had a sample size of 132 recordings. The best-performing binary classification model was a random forest model using the PLR parameters of latency, percent change, maximum diameter, minimum diameter, mean constriction velocity, and maximum constriction velocity as features. This model produced an overall accuracy of 93.5%, sensitivity of 96.2%, specificity of 90.9%, area under the curve of 0.936, and F1-score of 93.7% for differentiating between pupillary changes in mTBI and healthy participants. The absolute values are unable to be provided for the performance percentages reported here due to the mechanism of 10-fold cross validation that was used to obtain them.
In this pilot study, quantitative smartphone pupillometry demonstrates the potential to be a useful tool in the future diagnosis of acute mTBI.