Laura Miquel, Aubert Agostini, Anderson Loundou, Salima Daoud, Elisabetta Mazza, Malcolm G Munro, Patrice Crochet
{"title":"Reliability of an electronic uterine diagram to standardize intrauterine adhesion scoring.","authors":"Laura Miquel, Aubert Agostini, Anderson Loundou, Salima Daoud, Elisabetta Mazza, Malcolm G Munro, Patrice Crochet","doi":"10.1016/j.jmig.2024.12.016","DOIUrl":null,"url":null,"abstract":"<p><strong>Study objective: </strong>To study the inter-rater reliability of an electronic complementary uterine diagram (eAFS) in comparison to the conventional American Fertility Society intrauterine adhesions (IUA) scoring system (cAFS). As a secondary aim we wanted to assess the intra-rater reliability of these tools.</p><p><strong>Design: </strong>This was an observational cross over study with a nested test re-test design.</p><p><strong>Setting: </strong>Self-identified gynecologists who performed diagnostic hysteroscopy as part of their routine practice were asked to score IUA on 7 preselected videos using both cAFS and eAFS tools in two separate rounds. The order of use of tools was determined at random. Gynecologists who agreed to be involved in a 3<sup>rd</sup> round were asked to use the tool they were allocated to in the first round to assess intra-rater variability.</p><p><strong>Patients: </strong>No patients were recruited for the purpose of this study.</p><p><strong>Measurements: </strong>Inter-rater agreement between evaluators when using eAFS and cAFS for IUA scoring.</p><p><strong>Main results: </strong>Overall, the inter-rater agreement was fair (0.25 [CI 0.17 - 0.34] for cAFS and moderate (0.53 [CI 0.48 -0.58] for the eAFS tool. The biggest difference between both tools was seen in the \"extent of cavity involved\" component, which was fair (0.28 [CI 0.21 - 0.35]) vs. substantial (0.71 [CI 0.64 - 0.78]) for cAFS vs. eAFS respectively. Moreover, agreement coefficients were comparable amongst \"expert\" and \"non-expert\" evaluators with the use of the eAFS tool. Moreover, intra-rater perfect agreement was higher with the use of eAFS compared to cAFS (38% vs 32.5%).</p><p><strong>Conclusion: </strong>The current AFS IUA scoring system has fair inter-rater agreement. However, using a complementary electronic uterine diagram increased this agreement from fair to moderate overall and from fair to substantial in the \"extent of adhesions\" domain of the tool. Use of the electronic diagram also improved inter-rater agreement amongst non-experts making it comparable to that of experts.</p>","PeriodicalId":16397,"journal":{"name":"Journal of minimally invasive gynecology","volume":" ","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2024-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of minimally invasive gynecology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.jmig.2024.12.016","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OBSTETRICS & GYNECOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Study objective: To study the inter-rater reliability of an electronic complementary uterine diagram (eAFS) in comparison to the conventional American Fertility Society intrauterine adhesions (IUA) scoring system (cAFS). As a secondary aim we wanted to assess the intra-rater reliability of these tools.
Design: This was an observational cross over study with a nested test re-test design.
Setting: Self-identified gynecologists who performed diagnostic hysteroscopy as part of their routine practice were asked to score IUA on 7 preselected videos using both cAFS and eAFS tools in two separate rounds. The order of use of tools was determined at random. Gynecologists who agreed to be involved in a 3rd round were asked to use the tool they were allocated to in the first round to assess intra-rater variability.
Patients: No patients were recruited for the purpose of this study.
Measurements: Inter-rater agreement between evaluators when using eAFS and cAFS for IUA scoring.
Main results: Overall, the inter-rater agreement was fair (0.25 [CI 0.17 - 0.34] for cAFS and moderate (0.53 [CI 0.48 -0.58] for the eAFS tool. The biggest difference between both tools was seen in the "extent of cavity involved" component, which was fair (0.28 [CI 0.21 - 0.35]) vs. substantial (0.71 [CI 0.64 - 0.78]) for cAFS vs. eAFS respectively. Moreover, agreement coefficients were comparable amongst "expert" and "non-expert" evaluators with the use of the eAFS tool. Moreover, intra-rater perfect agreement was higher with the use of eAFS compared to cAFS (38% vs 32.5%).
Conclusion: The current AFS IUA scoring system has fair inter-rater agreement. However, using a complementary electronic uterine diagram increased this agreement from fair to moderate overall and from fair to substantial in the "extent of adhesions" domain of the tool. Use of the electronic diagram also improved inter-rater agreement amongst non-experts making it comparable to that of experts.
期刊介绍：
The Journal of Minimally Invasive Gynecology, formerly titled The Journal of the American Association of Gynecologic Laparoscopists, is an international clinical forum for the exchange and dissemination of ideas, findings and techniques relevant to gynecologic endoscopy and other minimally invasive procedures. The Journal, which presents research, clinical opinions and case reports from the brightest minds in gynecologic surgery, is an authoritative source informing practicing physicians of the latest, cutting-edge developments occurring in this emerging field.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
