特邀会议三:视网膜诊断的机器学习和人工智能方法:优化临床医生-人工智能团队以加强青光眼护理。

IF 2.3 4区 心理学 Q2 OPHTHALMOLOGY
Jithin Yohannan
{"title":"特邀会议三:视网膜诊断的机器学习和人工智能方法:优化临床医生-人工智能团队以加强青光眼护理。","authors":"Jithin Yohannan","doi":"10.1167/jov.25.5.32","DOIUrl":null,"url":null,"abstract":"<p><p>We investigated how AI explanations help primary eye care providers differentiate between immediate and non-urgent referrals for glaucoma surgical care. We developed explainable AI algorithms to predict glaucoma surgery needs from routine eye care data to identify high-risk patients. We included intrinsic and post-hoc explainability and conducted an online study with optometrists to assess human-AI team performance, measuring referral accuracy, interaction with AI, agreement rates, task time, and user experience perceptions. AI support improved referral accuracy among 87 participants (59.9% with AI vs. 50.8% without), though Human-AI teams underperformed compared to AI alone - on a separate test set, our black-box and intrinsic models achieved 77% and 71% accuracy, respectively, in predicting surgical outcomes. Participants felt they used AI advice more with the intrinsic model, finding it more useful and promising. Without explanations, deviations from AI recommendations increased. AI support did not increase workload, confidence, and trust but reduced challenges.We identify opportunities for human-AI teaming in glaucoma management, noting that AI enhances referral accuracy but shows a performance gap compared to AI alone, even with explanations. Becasue, human involvement remains crucial in medical decision-making, highlighting the need for future research to optimize collaboration, ensuring positive experiences and safe AI use.</p>","PeriodicalId":49955,"journal":{"name":"Journal of Vision","volume":"25 5","pages":"32"},"PeriodicalIF":2.3000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Invited Session III: Machine Learning and AI Approaches to Retinal Diagnostics: Optimizing clinician-AI teaming to enhance glaucoma care.\",\"authors\":\"Jithin Yohannan\",\"doi\":\"10.1167/jov.25.5.32\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>We investigated how AI explanations help primary eye care providers differentiate between immediate and non-urgent referrals for glaucoma surgical care. We developed explainable AI algorithms to predict glaucoma surgery needs from routine eye care data to identify high-risk patients. We included intrinsic and post-hoc explainability and conducted an online study with optometrists to assess human-AI team performance, measuring referral accuracy, interaction with AI, agreement rates, task time, and user experience perceptions. AI support improved referral accuracy among 87 participants (59.9% with AI vs. 50.8% without), though Human-AI teams underperformed compared to AI alone - on a separate test set, our black-box and intrinsic models achieved 77% and 71% accuracy, respectively, in predicting surgical outcomes. Participants felt they used AI advice more with the intrinsic model, finding it more useful and promising. Without explanations, deviations from AI recommendations increased. AI support did not increase workload, confidence, and trust but reduced challenges.We identify opportunities for human-AI teaming in glaucoma management, noting that AI enhances referral accuracy but shows a performance gap compared to AI alone, even with explanations. Becasue, human involvement remains crucial in medical decision-making, highlighting the need for future research to optimize collaboration, ensuring positive experiences and safe AI use.</p>\",\"PeriodicalId\":49955,\"journal\":{\"name\":\"Journal of Vision\",\"volume\":\"25 5\",\"pages\":\"32\"},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2025-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Vision\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1167/jov.25.5.32\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPHTHALMOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Vision","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1167/jov.25.5.32","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

我们调查了人工智能解释如何帮助初级眼科保健提供者区分青光眼手术护理的即时和非紧急转诊。我们开发了可解释的人工智能算法,从常规眼科护理数据中预测青光眼手术需求,以识别高风险患者。我们纳入了内在的和事后的可解释性,并与验光师进行了一项在线研究,以评估人类-人工智能团队的表现,测量推荐准确性、与人工智能的互动、协议率、任务时间和用户体验感知。人工智能支持提高了87名参与者的转诊准确性(有人工智能的人占59.9%,没有人工智能的人占50.8%),尽管人工智能团队的表现不如单独使用人工智能——在一个单独的测试集上,我们的黑盒模型和内在模型在预测手术结果方面分别达到了77%和71%的准确率。参与者认为,他们更多地将人工智能建议与内在模型结合起来,发现它更有用、更有前途。在没有解释的情况下,与人工智能建议的偏差增加了。人工智能支持并没有增加工作量、信心和信任,而是减少了挑战。我们发现了人类与人工智能合作治疗青光眼的机会,并指出人工智能提高了转诊的准确性,但与单独使用人工智能相比,即使有解释,也存在性能差距。因为,人类参与在医疗决策中仍然至关重要,这凸显了未来研究优化协作、确保积极体验和安全使用人工智能的必要性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Invited Session III: Machine Learning and AI Approaches to Retinal Diagnostics: Optimizing clinician-AI teaming to enhance glaucoma care.

We investigated how AI explanations help primary eye care providers differentiate between immediate and non-urgent referrals for glaucoma surgical care. We developed explainable AI algorithms to predict glaucoma surgery needs from routine eye care data to identify high-risk patients. We included intrinsic and post-hoc explainability and conducted an online study with optometrists to assess human-AI team performance, measuring referral accuracy, interaction with AI, agreement rates, task time, and user experience perceptions. AI support improved referral accuracy among 87 participants (59.9% with AI vs. 50.8% without), though Human-AI teams underperformed compared to AI alone - on a separate test set, our black-box and intrinsic models achieved 77% and 71% accuracy, respectively, in predicting surgical outcomes. Participants felt they used AI advice more with the intrinsic model, finding it more useful and promising. Without explanations, deviations from AI recommendations increased. AI support did not increase workload, confidence, and trust but reduced challenges.We identify opportunities for human-AI teaming in glaucoma management, noting that AI enhances referral accuracy but shows a performance gap compared to AI alone, even with explanations. Becasue, human involvement remains crucial in medical decision-making, highlighting the need for future research to optimize collaboration, ensuring positive experiences and safe AI use.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Vision
Journal of Vision 医学-眼科学
CiteScore
2.90
自引率
5.60%
发文量
218
审稿时长
3-6 weeks
期刊介绍: Exploring all aspects of biological visual function, including spatial vision, perception, low vision, color vision and more, spanning the fields of neuroscience, psychology and psychophysics.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信