Heba Talla Mohammed, Samantha Bestavros, Samiha Mohsen, Zheng Liu, Sheila Wang, Justin Allport, Amy Cassata, Robert D. J. Fraser
{"title":"评估临床医生对伤口组织分类的一致性和人工智能辅助量化的价值:一项横断面研究","authors":"Heba Talla Mohammed, Samantha Bestavros, Samiha Mohsen, Zheng Liu, Sheila Wang, Justin Allport, Amy Cassata, Robert D. J. Fraser","doi":"10.1111/iwj.70691","DOIUrl":null,"url":null,"abstract":"<p>This study investigated the relationship between clinician assessments and the AI-generated scores, highlighting how correlations vary based on clinician expertise. It also explored the proportion of tissue types identified by clinicians relative to AI assessments and assess the inter-clinician agreement in quantifying tissue types, identifying variations based on clinician experience. A cross-sectional survey used purposive, non-random sampling to recruit 50 wound care clinicians. Participants reported their specialisation and experience level before identifying and quantifying granulation, slough, eschar, and epithelialisation in nine wound images. An AI model analysed the same images for comparison. Experienced clinicians and wound care specialists reported higher confidence in assessments. Inter-clinician agreement was moderate–good for granulation and slough (ICC: 0.763–0.762) and moderate–excellent for eschar (ICC: 0.910), but moderate–poor for epithelialisation (ICC: 0.435). Clinicians strongly correlated with AI for granulation, slough, and eschar (<i>r</i> = 0.879, 0.955 and 0.984, respectively). Epithelialisation was more challenging, with a 60% identification rate and moderate correlation with AI (<i>r</i> = 0.579). AI-generated scores aligned with clinician assessments for granulation, slough, and eschar. However, epithelialisation, which is crucial for objectively measuring healing progress, showed greater variability, suggesting that AI could improve the reliability of its assessment, potentially leading to more consistent wound evaluation to guide treatment decisions.</p>","PeriodicalId":14451,"journal":{"name":"International Wound Journal","volume":"22 6","pages":""},"PeriodicalIF":2.6000,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/iwj.70691","citationCount":"0","resultStr":"{\"title\":\"Assessing Clinician Consistency in Wound Tissue Classification and the Value of AI-Assisted Quantification: A Cross-Sectional Study\",\"authors\":\"Heba Talla Mohammed, Samantha Bestavros, Samiha Mohsen, Zheng Liu, Sheila Wang, Justin Allport, Amy Cassata, Robert D. J. Fraser\",\"doi\":\"10.1111/iwj.70691\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>This study investigated the relationship between clinician assessments and the AI-generated scores, highlighting how correlations vary based on clinician expertise. It also explored the proportion of tissue types identified by clinicians relative to AI assessments and assess the inter-clinician agreement in quantifying tissue types, identifying variations based on clinician experience. A cross-sectional survey used purposive, non-random sampling to recruit 50 wound care clinicians. Participants reported their specialisation and experience level before identifying and quantifying granulation, slough, eschar, and epithelialisation in nine wound images. An AI model analysed the same images for comparison. Experienced clinicians and wound care specialists reported higher confidence in assessments. Inter-clinician agreement was moderate–good for granulation and slough (ICC: 0.763–0.762) and moderate–excellent for eschar (ICC: 0.910), but moderate–poor for epithelialisation (ICC: 0.435). Clinicians strongly correlated with AI for granulation, slough, and eschar (<i>r</i> = 0.879, 0.955 and 0.984, respectively). Epithelialisation was more challenging, with a 60% identification rate and moderate correlation with AI (<i>r</i> = 0.579). AI-generated scores aligned with clinician assessments for granulation, slough, and eschar. However, epithelialisation, which is crucial for objectively measuring healing progress, showed greater variability, suggesting that AI could improve the reliability of its assessment, potentially leading to more consistent wound evaluation to guide treatment decisions.</p>\",\"PeriodicalId\":14451,\"journal\":{\"name\":\"International Wound Journal\",\"volume\":\"22 6\",\"pages\":\"\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2025-05-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1111/iwj.70691\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Wound Journal\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/iwj.70691\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"DERMATOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Wound Journal","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/iwj.70691","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"DERMATOLOGY","Score":null,"Total":0}
Assessing Clinician Consistency in Wound Tissue Classification and the Value of AI-Assisted Quantification: A Cross-Sectional Study
This study investigated the relationship between clinician assessments and the AI-generated scores, highlighting how correlations vary based on clinician expertise. It also explored the proportion of tissue types identified by clinicians relative to AI assessments and assess the inter-clinician agreement in quantifying tissue types, identifying variations based on clinician experience. A cross-sectional survey used purposive, non-random sampling to recruit 50 wound care clinicians. Participants reported their specialisation and experience level before identifying and quantifying granulation, slough, eschar, and epithelialisation in nine wound images. An AI model analysed the same images for comparison. Experienced clinicians and wound care specialists reported higher confidence in assessments. Inter-clinician agreement was moderate–good for granulation and slough (ICC: 0.763–0.762) and moderate–excellent for eschar (ICC: 0.910), but moderate–poor for epithelialisation (ICC: 0.435). Clinicians strongly correlated with AI for granulation, slough, and eschar (r = 0.879, 0.955 and 0.984, respectively). Epithelialisation was more challenging, with a 60% identification rate and moderate correlation with AI (r = 0.579). AI-generated scores aligned with clinician assessments for granulation, slough, and eschar. However, epithelialisation, which is crucial for objectively measuring healing progress, showed greater variability, suggesting that AI could improve the reliability of its assessment, potentially leading to more consistent wound evaluation to guide treatment decisions.
期刊介绍:
The Editors welcome papers on all aspects of prevention and treatment of wounds and associated conditions in the fields of surgery, dermatology, oncology, nursing, radiotherapy, physical therapy, occupational therapy and podiatry. The Journal accepts papers in the following categories:
- Research papers
- Review articles
- Clinical studies
- Letters
- News and Views: international perspectives, education initiatives, guidelines and different activities of groups and societies.
Calendar of events
The Editors are supported by a board of international experts and a panel of reviewers across a range of disciplines and specialties which ensures only the most current and relevant research is published.