Assessing Clinician Consistency in Wound Tissue Classification and the Value of AI-Assisted Quantification: A Cross-Sectional Study

IF 2.6 3区 医学 Q2 DERMATOLOGY
Heba Talla Mohammed, Samantha Bestavros, Samiha Mohsen, Zheng Liu, Sheila Wang, Justin Allport, Amy Cassata, Robert D. J. Fraser
{"title":"Assessing Clinician Consistency in Wound Tissue Classification and the Value of AI-Assisted Quantification: A Cross-Sectional Study","authors":"Heba Talla Mohammed,&nbsp;Samantha Bestavros,&nbsp;Samiha Mohsen,&nbsp;Zheng Liu,&nbsp;Sheila Wang,&nbsp;Justin Allport,&nbsp;Amy Cassata,&nbsp;Robert D. J. Fraser","doi":"10.1111/iwj.70691","DOIUrl":null,"url":null,"abstract":"<p>This study investigated the relationship between clinician assessments and the AI-generated scores, highlighting how correlations vary based on clinician expertise. It also explored the proportion of tissue types identified by clinicians relative to AI assessments and assess the inter-clinician agreement in quantifying tissue types, identifying variations based on clinician experience. A cross-sectional survey used purposive, non-random sampling to recruit 50 wound care clinicians. Participants reported their specialisation and experience level before identifying and quantifying granulation, slough, eschar, and epithelialisation in nine wound images. An AI model analysed the same images for comparison. Experienced clinicians and wound care specialists reported higher confidence in assessments. Inter-clinician agreement was moderate–good for granulation and slough (ICC: 0.763–0.762) and moderate–excellent for eschar (ICC: 0.910), but moderate–poor for epithelialisation (ICC: 0.435). Clinicians strongly correlated with AI for granulation, slough, and eschar (<i>r</i> = 0.879, 0.955 and 0.984, respectively). Epithelialisation was more challenging, with a 60% identification rate and moderate correlation with AI (<i>r</i> = 0.579). AI-generated scores aligned with clinician assessments for granulation, slough, and eschar. However, epithelialisation, which is crucial for objectively measuring healing progress, showed greater variability, suggesting that AI could improve the reliability of its assessment, potentially leading to more consistent wound evaluation to guide treatment decisions.</p>","PeriodicalId":14451,"journal":{"name":"International Wound Journal","volume":"22 6","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/iwj.70691","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Wound Journal","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/iwj.70691","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"DERMATOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

This study investigated the relationship between clinician assessments and the AI-generated scores, highlighting how correlations vary based on clinician expertise. It also explored the proportion of tissue types identified by clinicians relative to AI assessments and assess the inter-clinician agreement in quantifying tissue types, identifying variations based on clinician experience. A cross-sectional survey used purposive, non-random sampling to recruit 50 wound care clinicians. Participants reported their specialisation and experience level before identifying and quantifying granulation, slough, eschar, and epithelialisation in nine wound images. An AI model analysed the same images for comparison. Experienced clinicians and wound care specialists reported higher confidence in assessments. Inter-clinician agreement was moderate–good for granulation and slough (ICC: 0.763–0.762) and moderate–excellent for eschar (ICC: 0.910), but moderate–poor for epithelialisation (ICC: 0.435). Clinicians strongly correlated with AI for granulation, slough, and eschar (r = 0.879, 0.955 and 0.984, respectively). Epithelialisation was more challenging, with a 60% identification rate and moderate correlation with AI (r = 0.579). AI-generated scores aligned with clinician assessments for granulation, slough, and eschar. However, epithelialisation, which is crucial for objectively measuring healing progress, showed greater variability, suggesting that AI could improve the reliability of its assessment, potentially leading to more consistent wound evaluation to guide treatment decisions.

评估临床医生对伤口组织分类的一致性和人工智能辅助量化的价值:一项横断面研究
这项研究调查了临床医生的评估和人工智能生成的分数之间的关系,强调了临床医生专业知识的相关性是如何变化的。它还探讨了临床医生确定的组织类型相对于人工智能评估的比例,并评估了临床医生在量化组织类型方面的共识,并根据临床医生的经验确定差异。横断面调查采用有目的的,非随机抽样招募50伤口护理临床医生。参与者报告了他们的专业知识和经验水平,然后在9张伤口图像中识别和量化肉芽、脱落、痂和上皮化。人工智能模型分析了相同的图像进行比较。经验丰富的临床医生和伤口护理专家报告对评估的信心更高。临床医师间的一致性为:肉芽和结泥为中优(ICC: 0.763-0.762),焦痂为中优(ICC: 0.910),上皮化为中差(ICC: 0.435)。临床医生与肉芽、结泥和焦痂的AI密切相关(r分别= 0.879、0.955和0.984)。上皮化更具挑战性,识别率为60%,与AI有中等相关性(r = 0.579)。人工智能生成的评分与临床医生对肉芽、脱痂和焦痂的评估一致。然而,对于客观衡量愈合进展至关重要的上皮化表现出更大的可变性,这表明人工智能可以提高其评估的可靠性,可能导致更一致的伤口评估,以指导治疗决策。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
International Wound Journal
International Wound Journal DERMATOLOGY-SURGERY
CiteScore
4.50
自引率
12.90%
发文量
266
审稿时长
6-12 weeks
期刊介绍: The Editors welcome papers on all aspects of prevention and treatment of wounds and associated conditions in the fields of surgery, dermatology, oncology, nursing, radiotherapy, physical therapy, occupational therapy and podiatry. The Journal accepts papers in the following categories: - Research papers - Review articles - Clinical studies - Letters - News and Views: international perspectives, education initiatives, guidelines and different activities of groups and societies. Calendar of events The Editors are supported by a board of international experts and a panel of reviewers across a range of disciplines and specialties which ensures only the most current and relevant research is published.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信