Artificial intelligence-based multimodal framework for non-invasive detection of digital eye strain using thermal imaging and behavioral metrics

IF 2.9 2区 生物学 Q2 BIOLOGY
J. Persiya , A. Sasithradevi
{"title":"Artificial intelligence-based multimodal framework for non-invasive detection of digital eye strain using thermal imaging and behavioral metrics","authors":"J. Persiya ,&nbsp;A. Sasithradevi","doi":"10.1016/j.jtherbio.2025.104280","DOIUrl":null,"url":null,"abstract":"<div><div>Digital Eye Strain is an emerging occupational health concern with significant implications for digital well-being. To address the need for scalable and objective monitoring, EyeStrainNet is proposed. It is a multimodal and explainable health informatics framework that integrates thermal imaging and behavioral metrics for the non-invasive detection of Digital Eye Strain. Thermal images were captured pre- and post-screen exposure using a FLIR Edge Pro camera, and ocular temperature features were extracted from the inner and outer canthus and central cornea. Behavioral data, such as screen exposure duration and distraction levels, were recorded in parallel. A total of 197 samples (34 with significant strain, 163 without) were analyzed. Feature engineering and statistical analysis revealed strong correlations between ocular temperature changes and behavioral factors. The proposed EyeStrainNet, based on a one-dimensional convolutional neural network, was evaluated using 5-fold cross-validation. It achieved 97.5 % accuracy, 92.5 % precision, 94.3 % recall, 92.7 % F1-score, 99.7 % ROC-AUC, and 98.9 % PR-AUC, demonstrating strong performance with tight confidence intervals. EyeStrainNet outperformed baseline models such as One-Class SVM and XGBoost-SVM by 2–3 % in accuracy and 5–10 % in F1-score. SHAP-based explainability analysis identified temperature variation and distraction as dominant predictive features. This multimodal, explainable, and data-driven framework enables early-stage, non-clinical DES detection, promoting proactive digital wellness.</div></div>","PeriodicalId":17428,"journal":{"name":"Journal of thermal biology","volume":"133 ","pages":"Article 104280"},"PeriodicalIF":2.9000,"publicationDate":"2025-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of thermal biology","FirstCategoryId":"99","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306456525002372","RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"BIOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Digital Eye Strain is an emerging occupational health concern with significant implications for digital well-being. To address the need for scalable and objective monitoring, EyeStrainNet is proposed. It is a multimodal and explainable health informatics framework that integrates thermal imaging and behavioral metrics for the non-invasive detection of Digital Eye Strain. Thermal images were captured pre- and post-screen exposure using a FLIR Edge Pro camera, and ocular temperature features were extracted from the inner and outer canthus and central cornea. Behavioral data, such as screen exposure duration and distraction levels, were recorded in parallel. A total of 197 samples (34 with significant strain, 163 without) were analyzed. Feature engineering and statistical analysis revealed strong correlations between ocular temperature changes and behavioral factors. The proposed EyeStrainNet, based on a one-dimensional convolutional neural network, was evaluated using 5-fold cross-validation. It achieved 97.5 % accuracy, 92.5 % precision, 94.3 % recall, 92.7 % F1-score, 99.7 % ROC-AUC, and 98.9 % PR-AUC, demonstrating strong performance with tight confidence intervals. EyeStrainNet outperformed baseline models such as One-Class SVM and XGBoost-SVM by 2–3 % in accuracy and 5–10 % in F1-score. SHAP-based explainability analysis identified temperature variation and distraction as dominant predictive features. This multimodal, explainable, and data-driven framework enables early-stage, non-clinical DES detection, promoting proactive digital wellness.
基于人工智能的多模态框架,基于热成像和行为指标的无创数字眼疲劳检测
数字眼疲劳是一种新兴的职业健康问题,对数字健康有重大影响。为了满足可扩展和客观监测的需求,提出了EyeStrainNet。它是一个多模式和可解释的健康信息学框架,集成了热成像和行为指标,用于数字眼疲劳的非侵入性检测。使用FLIR Edge Pro相机拍摄屏幕曝光前后的热图像,并从内、外眼角和中央角膜提取眼部温度特征。同时记录行为数据,如屏幕暴露时间和分心程度。共分析了197份样品,其中34份菌株显著,163份不显著。特征工程和统计分析表明,眼温变化与行为因素有很强的相关性。提出的EyeStrainNet基于一维卷积神经网络,使用5倍交叉验证进行评估。准确率为97.5%,精密度为92.5%,召回率为94.3%,f1评分为92.7%,ROC-AUC为99.7%,PR-AUC为98.9%,具有较强的置信区间。EyeStrainNet在准确率上优于基准模型(如One-Class SVM和XGBoost-SVM) 2 - 3%,在F1-score上优于5 - 10%。基于shap的可解释性分析发现温度变化和分心是主要的预测特征。这种多模式、可解释和数据驱动的框架使早期、非临床DES检测成为可能,促进积极主动的数字健康。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of thermal biology
Journal of thermal biology 生物-动物学
CiteScore
5.30
自引率
7.40%
发文量
196
审稿时长
14.5 weeks
期刊介绍: The Journal of Thermal Biology publishes articles that advance our knowledge on the ways and mechanisms through which temperature affects man and animals. This includes studies of their responses to these effects and on the ecological consequences. Directly relevant to this theme are: • The mechanisms of thermal limitation, heat and cold injury, and the resistance of organisms to extremes of temperature • The mechanisms involved in acclimation, acclimatization and evolutionary adaptation to temperature • Mechanisms underlying the patterns of hibernation, torpor, dormancy, aestivation and diapause • Effects of temperature on reproduction and development, growth, ageing and life-span • Studies on modelling heat transfer between organisms and their environment • The contributions of temperature to effects of climate change on animal species and man • Studies of conservation biology and physiology related to temperature • Behavioural and physiological regulation of body temperature including its pathophysiology and fever • Medical applications of hypo- and hyperthermia Article types: • Original articles • Review articles
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信