Inter-reader reliability of Ovarian-Adnexal Reporting and Data System US: a systematic review and meta-analysis.

IF 2.3 3区医学 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING

Abdominal Radiology Pub Date : 2025-01-22 DOI:10.1007/s00261-025-04813-2

Sang Min Bae, Dong Hwan Kim, Ji Hun Kang

{"title":"Inter-reader reliability of Ovarian-Adnexal Reporting and Data System US: a systematic review and meta-analysis.","authors":"Sang Min Bae, Dong Hwan Kim, Ji Hun Kang","doi":"10.1007/s00261-025-04813-2","DOIUrl":null,"url":null,"abstract":"Purpose: Ovarian-Adnexal Reporting and Data System (O-RADS) US provides a standardized lexicon for ovarian and adnexal lesions, facilitating risk stratification based on morphological features for malignancy assessment, which is essential for proper management. However, systematic determination of inter-reader reliability in O-RADS US categorization remains unexplored. This study aimed to systematically determine the inter-reader reliability of O-RADS US categorization and identify the factors that affect it.Methods: Original articles reporting the inter-reader reliability of O-RADS US in lesion categorization were identified in the MEDLINE, EMBASE, and Web of Science databases from January 2018 to December 2023. DerSimonian-Laird random-effects models were used to determine the meta-analytic pooled inter-reader reliability of the O-RADS US categorization. Subgroup meta-regression analysis was performed to identify the factors causing study heterogeneity.Results: Fourteen original articles with 5139 ovarian and adnexal lesions were included. The inter-reader reliability of O-RADS US in lesion categorization ranged from 0.71 to 0.99, with a meta-analytic pooled estimate of 0.83 (95% CI, 0.78-0.88), indicating almost perfect reliability. Substantial study heterogeneity was observed in the inter-reader reliability of the O-RADS US categorization (I2 = 96.9). In subgroup meta-regression analysis, reader experience was the only factor associated with study heterogeneity. Pooled inter-reader reliability of the O-RADS US categorization was higher in studies with all experienced readers (0.86; 95% CI, 0.81-0.91) compared to those with multiple readers including trainees (0.74; 95% CI, 0.70-0.78; P = 0.009). The inter-reader reliability of US descriptors ranged from 0.39 to 0.97, with ascites and peritoneal nodules showing almost perfect reliability (0.79- 0.97).Conclusion: The O-RADS US risk stratification system demonstrated almost perfect inter-reader reliability in lesion categorization. Our results highlight the importance of targeted training and descriptor simplification to improve inter-reader reliability and clinical adoption.","PeriodicalId":7126,"journal":{"name":"Abdominal Radiology","volume":" ","pages":""},"PeriodicalIF":2.3000,"publicationDate":"2025-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Abdominal Radiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00261-025-04813-2","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}

引用次数: 0

Abstract

Purpose: Ovarian-Adnexal Reporting and Data System (O-RADS) US provides a standardized lexicon for ovarian and adnexal lesions, facilitating risk stratification based on morphological features for malignancy assessment, which is essential for proper management. However, systematic determination of inter-reader reliability in O-RADS US categorization remains unexplored. This study aimed to systematically determine the inter-reader reliability of O-RADS US categorization and identify the factors that affect it.

Methods: Original articles reporting the inter-reader reliability of O-RADS US in lesion categorization were identified in the MEDLINE, EMBASE, and Web of Science databases from January 2018 to December 2023. DerSimonian-Laird random-effects models were used to determine the meta-analytic pooled inter-reader reliability of the O-RADS US categorization. Subgroup meta-regression analysis was performed to identify the factors causing study heterogeneity.

Results: Fourteen original articles with 5139 ovarian and adnexal lesions were included. The inter-reader reliability of O-RADS US in lesion categorization ranged from 0.71 to 0.99, with a meta-analytic pooled estimate of 0.83 (95% CI, 0.78-0.88), indicating almost perfect reliability. Substantial study heterogeneity was observed in the inter-reader reliability of the O-RADS US categorization (I² = 96.9). In subgroup meta-regression analysis, reader experience was the only factor associated with study heterogeneity. Pooled inter-reader reliability of the O-RADS US categorization was higher in studies with all experienced readers (0.86; 95% CI, 0.81-0.91) compared to those with multiple readers including trainees (0.74; 95% CI, 0.70-0.78; P = 0.009). The inter-reader reliability of US descriptors ranged from 0.39 to 0.97, with ascites and peritoneal nodules showing almost perfect reliability (0.79- 0.97).

Conclusion: The O-RADS US risk stratification system demonstrated almost perfect inter-reader reliability in lesion categorization. Our results highlight the importance of targeted training and descriptor simplification to improve inter-reader reliability and clinical adoption.

查看原文本刊更多论文

美国卵巢附件报告和数据系统的读者间可靠性：一项系统回顾和荟萃分析。

目的：卵巢-附件报告和数据系统（O-RADS）为卵巢和附件病变提供了一个标准化的词汇，便于根据形态学特征进行恶性评估的风险分层，对正确的管理至关重要。然而，O-RADS US分类中读者间可靠性的系统测定仍未被探索。本研究旨在系统地确定O-RADS US分类的读者间信度，并确定影响其信度的因素。方法：从2018年1月至2023年12月的MEDLINE、EMBASE和Web of Science数据库中检索报道O-RADS US在病变分类中的读者间可靠性的原创文章。使用dersimonan - laird随机效应模型来确定O-RADS US分类的元分析合并读者间信度。进行亚组meta回归分析以确定导致研究异质性的因素。结果：纳入14篇原创文章5139例卵巢及附件病变。O-RADS US在病变分类中的读者间信度范围为0.71 ~ 0.99，meta分析汇总估计为0.83 (95% CI为0.78 ~ 0.88)，信度几乎为完美。O-RADS US分类的读者间信度存在显著的研究异质性（I2 = 96.9）。在亚组元回归分析中，读者体验是唯一与研究异质性相关的因素。所有有经验读者的研究中，O-RADS US分类的合并读者间信度更高(0.86；95% CI, 0.81-0.91)，与包括受训者在内的多个阅读者相比(0.74；95% ci, 0.70-0.78；p = 0.009)。US描述符的读者间信度范围为0.39 - 0.97，其中腹水和腹膜结节的信度几乎为完美（0.79- 0.97）。结论：O-RADS US风险分层系统在病变分类中表现出近乎完美的读者间可靠性。我们的研究结果强调了有针对性的训练和描述符简化对提高读者间可靠性和临床采用的重要性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Abdominal Radiology Medicine-Radiology, Nuclear Medicine and Imaging

CiteScore

5.20

自引率

8.30%

发文量

334

期刊介绍： Abdominal Radiology seeks to meet the professional needs of the abdominal radiologist by publishing clinically pertinent original, review and practice related articles on the gastrointestinal and genitourinary tracts and abdominal interventional and radiologic procedures. Case reports are generally not accepted unless they are the first report of a new disease or condition, or part of a special solicited section. Reasons to Publish Your Article in Abdominal Radiology: · Official journal of the Society of Abdominal Radiology (SAR) · Published in Cooperation with: European Society of Gastrointestinal and Abdominal Radiology (ESGAR) European Society of Urogenital Radiology (ESUR) Asian Society of Abdominal Radiology (ASAR) · Efficient handling and Expeditious review · Author feedback is provided in a mentoring style · Global readership · Readers can earn CME credits