Ivana Rizzuto, Shohreh Rezai, Annah Lane, Marita Prior, Kristy P Robledo, Andreas Obermair
{"title":"使用各种超声诊断模型对附件肿块的主观评估:观察者间变异性的分析。","authors":"Ivana Rizzuto, Shohreh Rezai, Annah Lane, Marita Prior, Kristy P Robledo, Andreas Obermair","doi":"10.1111/ajo.70036","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>To investigate the interobserver agreement of the International Ovarian Tumour Analysis (IOTA) ultrasound-based simple rules risk (SRRisk) score, the logistic regression model 2 (LR2), the Assessment of Different NEoplasias in the adneXa (ADNEX) model and the Ovarian-Adnexal Reporting and Data System (O-RADS) in an Australian, population-based context.</p><p><strong>Methods: </strong>A retrospective multi-centre study was performed between January 2020 and January 2021. The study included 198 women with adnexal masses examined with transvaginal grey scale and power Doppler ultrasound. Participants were recruited from the multidisciplinary oncology meetings (MDT) of two tertiary cancer centres. Two independent radiologists described the adnexal masses according to the SRR, LR2 scores, ADNEX model, and O-RADS. Values > 30 units different were considered differential and > 50 units were considered highly differential.</p><p><strong>Results: </strong>From 198 patients, 128 were diagnosed with benign ovarian masses, 53 with malignant and 17 patients with borderline tumours. There was strong agreement (Cohen's kappa 0.8) for intra-tumour blood flow, number of cysts locules, and presence of blood flow within solid projections. Interobserver agreement was moderate (Cohen's kappa 0.60-0.79) for the presence of free pelvic fluid/ascites, solid components, unilocular cysts and acoustic shadows. Of the 198 cases, 10 (5%) cases were highly differential and (38/198) 19% were differential for SRRisk, (20/198) 10% highly differential and (36/198) 18% differential for LR2, and (10/198) 5% and (24/198) 12% for ADNEXA model, respectively. Comparison of O-RADS scores between the two observers showed a moderate agreement with a kappa of 0.65. In 7/198 (4%) cases, the difference between observers was for 2 or more categories when using the O-RADS score.</p><p><strong>Conclusions: </strong>Our results suggested that interobserver variation was present in evaluating adnexal masses using well established ultrasonographic diagnostic models. Implementation of sonographic ovarian cancer risk prediction models will need to consider this issue and ensure examiners have adequate training in the technique, and standard operating procedures are in place to reduce interobserver variability.</p>","PeriodicalId":55429,"journal":{"name":"Australian & New Zealand Journal of Obstetrics & Gynaecology","volume":" ","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2025-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Subjective Assessment of Adnexal Masses Using Various Ultrasonographic Diagnostic Models: An Analysis of Interobserver Variability.\",\"authors\":\"Ivana Rizzuto, Shohreh Rezai, Annah Lane, Marita Prior, Kristy P Robledo, Andreas Obermair\",\"doi\":\"10.1111/ajo.70036\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>To investigate the interobserver agreement of the International Ovarian Tumour Analysis (IOTA) ultrasound-based simple rules risk (SRRisk) score, the logistic regression model 2 (LR2), the Assessment of Different NEoplasias in the adneXa (ADNEX) model and the Ovarian-Adnexal Reporting and Data System (O-RADS) in an Australian, population-based context.</p><p><strong>Methods: </strong>A retrospective multi-centre study was performed between January 2020 and January 2021. The study included 198 women with adnexal masses examined with transvaginal grey scale and power Doppler ultrasound. Participants were recruited from the multidisciplinary oncology meetings (MDT) of two tertiary cancer centres. Two independent radiologists described the adnexal masses according to the SRR, LR2 scores, ADNEX model, and O-RADS. Values > 30 units different were considered differential and > 50 units were considered highly differential.</p><p><strong>Results: </strong>From 198 patients, 128 were diagnosed with benign ovarian masses, 53 with malignant and 17 patients with borderline tumours. There was strong agreement (Cohen's kappa 0.8) for intra-tumour blood flow, number of cysts locules, and presence of blood flow within solid projections. Interobserver agreement was moderate (Cohen's kappa 0.60-0.79) for the presence of free pelvic fluid/ascites, solid components, unilocular cysts and acoustic shadows. Of the 198 cases, 10 (5%) cases were highly differential and (38/198) 19% were differential for SRRisk, (20/198) 10% highly differential and (36/198) 18% differential for LR2, and (10/198) 5% and (24/198) 12% for ADNEXA model, respectively. Comparison of O-RADS scores between the two observers showed a moderate agreement with a kappa of 0.65. In 7/198 (4%) cases, the difference between observers was for 2 or more categories when using the O-RADS score.</p><p><strong>Conclusions: </strong>Our results suggested that interobserver variation was present in evaluating adnexal masses using well established ultrasonographic diagnostic models. Implementation of sonographic ovarian cancer risk prediction models will need to consider this issue and ensure examiners have adequate training in the technique, and standard operating procedures are in place to reduce interobserver variability.</p>\",\"PeriodicalId\":55429,\"journal\":{\"name\":\"Australian & New Zealand Journal of Obstetrics & Gynaecology\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2025-05-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Australian & New Zealand Journal of Obstetrics & Gynaecology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1111/ajo.70036\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"OBSTETRICS & GYNECOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Australian & New Zealand Journal of Obstetrics & Gynaecology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/ajo.70036","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"OBSTETRICS & GYNECOLOGY","Score":null,"Total":0}
Subjective Assessment of Adnexal Masses Using Various Ultrasonographic Diagnostic Models: An Analysis of Interobserver Variability.
Objective: To investigate the interobserver agreement of the International Ovarian Tumour Analysis (IOTA) ultrasound-based simple rules risk (SRRisk) score, the logistic regression model 2 (LR2), the Assessment of Different NEoplasias in the adneXa (ADNEX) model and the Ovarian-Adnexal Reporting and Data System (O-RADS) in an Australian, population-based context.
Methods: A retrospective multi-centre study was performed between January 2020 and January 2021. The study included 198 women with adnexal masses examined with transvaginal grey scale and power Doppler ultrasound. Participants were recruited from the multidisciplinary oncology meetings (MDT) of two tertiary cancer centres. Two independent radiologists described the adnexal masses according to the SRR, LR2 scores, ADNEX model, and O-RADS. Values > 30 units different were considered differential and > 50 units were considered highly differential.
Results: From 198 patients, 128 were diagnosed with benign ovarian masses, 53 with malignant and 17 patients with borderline tumours. There was strong agreement (Cohen's kappa 0.8) for intra-tumour blood flow, number of cysts locules, and presence of blood flow within solid projections. Interobserver agreement was moderate (Cohen's kappa 0.60-0.79) for the presence of free pelvic fluid/ascites, solid components, unilocular cysts and acoustic shadows. Of the 198 cases, 10 (5%) cases were highly differential and (38/198) 19% were differential for SRRisk, (20/198) 10% highly differential and (36/198) 18% differential for LR2, and (10/198) 5% and (24/198) 12% for ADNEXA model, respectively. Comparison of O-RADS scores between the two observers showed a moderate agreement with a kappa of 0.65. In 7/198 (4%) cases, the difference between observers was for 2 or more categories when using the O-RADS score.
Conclusions: Our results suggested that interobserver variation was present in evaluating adnexal masses using well established ultrasonographic diagnostic models. Implementation of sonographic ovarian cancer risk prediction models will need to consider this issue and ensure examiners have adequate training in the technique, and standard operating procedures are in place to reduce interobserver variability.
期刊介绍:
The Australian and New Zealand Journal of Obstetrics and Gynaecology (ANZJOG) is an editorially independent publication owned by the Royal Australian and New Zealand College of Obstetricians and Gynaecologists (RANZCOG) and the RANZCOG Research foundation. ANZJOG aims to provide a medium for the publication of original contributions to clinical practice and/or research in all fields of obstetrics and gynaecology and related disciplines. Articles are peer reviewed by clinicians or researchers expert in the field of the submitted work. From time to time the journal will also publish printed abstracts from the RANZCOG Annual Scientific Meeting and meetings of relevant special interest groups, where the accepted abstracts have undergone the journals peer review acceptance process.