{"title":"特邀会议三:视网膜诊断的机器学习和人工智能方法:优化临床医生-人工智能团队以加强青光眼护理。","authors":"Jithin Yohannan","doi":"10.1167/jov.25.5.32","DOIUrl":null,"url":null,"abstract":"<p><p>We investigated how AI explanations help primary eye care providers differentiate between immediate and non-urgent referrals for glaucoma surgical care. We developed explainable AI algorithms to predict glaucoma surgery needs from routine eye care data to identify high-risk patients. We included intrinsic and post-hoc explainability and conducted an online study with optometrists to assess human-AI team performance, measuring referral accuracy, interaction with AI, agreement rates, task time, and user experience perceptions. AI support improved referral accuracy among 87 participants (59.9% with AI vs. 50.8% without), though Human-AI teams underperformed compared to AI alone - on a separate test set, our black-box and intrinsic models achieved 77% and 71% accuracy, respectively, in predicting surgical outcomes. Participants felt they used AI advice more with the intrinsic model, finding it more useful and promising. Without explanations, deviations from AI recommendations increased. AI support did not increase workload, confidence, and trust but reduced challenges.We identify opportunities for human-AI teaming in glaucoma management, noting that AI enhances referral accuracy but shows a performance gap compared to AI alone, even with explanations. Becasue, human involvement remains crucial in medical decision-making, highlighting the need for future research to optimize collaboration, ensuring positive experiences and safe AI use.</p>","PeriodicalId":49955,"journal":{"name":"Journal of Vision","volume":"25 5","pages":"32"},"PeriodicalIF":2.3000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Invited Session III: Machine Learning and AI Approaches to Retinal Diagnostics: Optimizing clinician-AI teaming to enhance glaucoma care.\",\"authors\":\"Jithin Yohannan\",\"doi\":\"10.1167/jov.25.5.32\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>We investigated how AI explanations help primary eye care providers differentiate between immediate and non-urgent referrals for glaucoma surgical care. We developed explainable AI algorithms to predict glaucoma surgery needs from routine eye care data to identify high-risk patients. We included intrinsic and post-hoc explainability and conducted an online study with optometrists to assess human-AI team performance, measuring referral accuracy, interaction with AI, agreement rates, task time, and user experience perceptions. AI support improved referral accuracy among 87 participants (59.9% with AI vs. 50.8% without), though Human-AI teams underperformed compared to AI alone - on a separate test set, our black-box and intrinsic models achieved 77% and 71% accuracy, respectively, in predicting surgical outcomes. Participants felt they used AI advice more with the intrinsic model, finding it more useful and promising. Without explanations, deviations from AI recommendations increased. AI support did not increase workload, confidence, and trust but reduced challenges.We identify opportunities for human-AI teaming in glaucoma management, noting that AI enhances referral accuracy but shows a performance gap compared to AI alone, even with explanations. Becasue, human involvement remains crucial in medical decision-making, highlighting the need for future research to optimize collaboration, ensuring positive experiences and safe AI use.</p>\",\"PeriodicalId\":49955,\"journal\":{\"name\":\"Journal of Vision\",\"volume\":\"25 5\",\"pages\":\"32\"},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2025-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Vision\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1167/jov.25.5.32\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPHTHALMOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Vision","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1167/jov.25.5.32","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
Invited Session III: Machine Learning and AI Approaches to Retinal Diagnostics: Optimizing clinician-AI teaming to enhance glaucoma care.
We investigated how AI explanations help primary eye care providers differentiate between immediate and non-urgent referrals for glaucoma surgical care. We developed explainable AI algorithms to predict glaucoma surgery needs from routine eye care data to identify high-risk patients. We included intrinsic and post-hoc explainability and conducted an online study with optometrists to assess human-AI team performance, measuring referral accuracy, interaction with AI, agreement rates, task time, and user experience perceptions. AI support improved referral accuracy among 87 participants (59.9% with AI vs. 50.8% without), though Human-AI teams underperformed compared to AI alone - on a separate test set, our black-box and intrinsic models achieved 77% and 71% accuracy, respectively, in predicting surgical outcomes. Participants felt they used AI advice more with the intrinsic model, finding it more useful and promising. Without explanations, deviations from AI recommendations increased. AI support did not increase workload, confidence, and trust but reduced challenges.We identify opportunities for human-AI teaming in glaucoma management, noting that AI enhances referral accuracy but shows a performance gap compared to AI alone, even with explanations. Becasue, human involvement remains crucial in medical decision-making, highlighting the need for future research to optimize collaboration, ensuring positive experiences and safe AI use.
期刊介绍:
Exploring all aspects of biological visual function, including spatial vision, perception,
low vision, color vision and more, spanning the fields of neuroscience, psychology and psychophysics.