Heba Talla Mohammed, Samantha Bestavros, Samiha Mohsen, Zheng Liu, Sheila Wang, Justin Allport, Amy Cassata, Robert D. J. Fraser
{"title":"Assessing Clinician Consistency in Wound Tissue Classification and the Value of AI-Assisted Quantification: A Cross-Sectional Study","authors":"Heba Talla Mohammed, Samantha Bestavros, Samiha Mohsen, Zheng Liu, Sheila Wang, Justin Allport, Amy Cassata, Robert D. J. Fraser","doi":"10.1111/iwj.70691","DOIUrl":null,"url":null,"abstract":"<p>This study investigated the relationship between clinician assessments and the AI-generated scores, highlighting how correlations vary based on clinician expertise. It also explored the proportion of tissue types identified by clinicians relative to AI assessments and assess the inter-clinician agreement in quantifying tissue types, identifying variations based on clinician experience. A cross-sectional survey used purposive, non-random sampling to recruit 50 wound care clinicians. Participants reported their specialisation and experience level before identifying and quantifying granulation, slough, eschar, and epithelialisation in nine wound images. An AI model analysed the same images for comparison. Experienced clinicians and wound care specialists reported higher confidence in assessments. Inter-clinician agreement was moderate–good for granulation and slough (ICC: 0.763–0.762) and moderate–excellent for eschar (ICC: 0.910), but moderate–poor for epithelialisation (ICC: 0.435). Clinicians strongly correlated with AI for granulation, slough, and eschar (<i>r</i> = 0.879, 0.955 and 0.984, respectively). Epithelialisation was more challenging, with a 60% identification rate and moderate correlation with AI (<i>r</i> = 0.579). AI-generated scores aligned with clinician assessments for granulation, slough, and eschar. However, epithelialisation, which is crucial for objectively measuring healing progress, showed greater variability, suggesting that AI could improve the reliability of its assessment, potentially leading to more consistent wound evaluation to guide treatment decisions.</p>","PeriodicalId":14451,"journal":{"name":"International Wound Journal","volume":"22 6","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/iwj.70691","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Wound Journal","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/iwj.70691","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"DERMATOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
This study investigated the relationship between clinician assessments and the AI-generated scores, highlighting how correlations vary based on clinician expertise. It also explored the proportion of tissue types identified by clinicians relative to AI assessments and assess the inter-clinician agreement in quantifying tissue types, identifying variations based on clinician experience. A cross-sectional survey used purposive, non-random sampling to recruit 50 wound care clinicians. Participants reported their specialisation and experience level before identifying and quantifying granulation, slough, eschar, and epithelialisation in nine wound images. An AI model analysed the same images for comparison. Experienced clinicians and wound care specialists reported higher confidence in assessments. Inter-clinician agreement was moderate–good for granulation and slough (ICC: 0.763–0.762) and moderate–excellent for eschar (ICC: 0.910), but moderate–poor for epithelialisation (ICC: 0.435). Clinicians strongly correlated with AI for granulation, slough, and eschar (r = 0.879, 0.955 and 0.984, respectively). Epithelialisation was more challenging, with a 60% identification rate and moderate correlation with AI (r = 0.579). AI-generated scores aligned with clinician assessments for granulation, slough, and eschar. However, epithelialisation, which is crucial for objectively measuring healing progress, showed greater variability, suggesting that AI could improve the reliability of its assessment, potentially leading to more consistent wound evaluation to guide treatment decisions.
期刊介绍:
The Editors welcome papers on all aspects of prevention and treatment of wounds and associated conditions in the fields of surgery, dermatology, oncology, nursing, radiotherapy, physical therapy, occupational therapy and podiatry. The Journal accepts papers in the following categories:
- Research papers
- Review articles
- Clinical studies
- Letters
- News and Views: international perspectives, education initiatives, guidelines and different activities of groups and societies.
Calendar of events
The Editors are supported by a board of international experts and a panel of reviewers across a range of disciplines and specialties which ensures only the most current and relevant research is published.