Dong-Dong Jin, Bo-Wen Zhuang, Ke Lin, Nan Zhang, Bin Qiao, Xiao-Yan Xie, Xiao-Hua Xie, Yan Wang
{"title":"Contrast-enhanced US Bosniak Classification: intra- and inter-rater agreement, confounding features, and diagnostic performance.","authors":"Dong-Dong Jin, Bo-Wen Zhuang, Ke Lin, Nan Zhang, Bin Qiao, Xiao-Yan Xie, Xiao-Hua Xie, Yan Wang","doi":"10.1186/s13244-024-01858-7","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The contrast-enhanced US (CEUS) Bosniak classification, proposed by the European Federation for Ultrasound in Medicine and Biology (EFSUMB) in 2020, predicts malignancy in cystic renal masses (CRMs). However, intra- and inter-rater reproducibility for CEUS features has not been well investigated.</p><p><strong>Purpose: </strong>To explore intra- and inter-rater agreement for US features, identify confounding features, and assess the diagnostic performance of CEUS Bosniak classification.</p><p><strong>Materials and methods: </strong>This retrospective study included patients with complex CRMs who underwent CEUS examination from January 2013 to August 2023. Radiologists (3 experts and 3 novices) evaluated calcification, echogenic content, wall, septa, and internal nodules of CRMs using CEUS Bosniak classification. Intra- and inter-rater agreements were assessed using the Gwet agreement coefficient (Gwet's AC). Linear regression identified features associated with discrepancies in Bosniak category assignment. Diagnostic performance was evaluated using the area under the receiver operating characteristic curve (AUC).</p><p><strong>Results: </strong>A total of 103 complex CRMs were analyzed in 103 patients (mean age, 50 ± 15 years; 66 males). Intra-rater agreement for the Bosniak category was substantial to almost perfect (Gwet's AC 0.73-0.87). Inter-rater agreement was substantial for the Bosniak category (Gwet's AC 0.75) and moderate to almost perfect for US features (Gwet's AC 0.44-0.94). Nodule variation (i.e., absence vs. obtuse margin vs. acute margin) explained 84% of the variability in the Bosniak category assignment. CEUS Bosniak classification showed good diagnostic performance, with AUCs ranging from 0.78 to 0.90 for each rater.</p><p><strong>Conclusions: </strong>CEUS Bosniak classification demonstrated substantial intra- and inter-rater reproducibility and good diagnostic performance in predicting the malignancy potential of CRMs. Nodule variations significantly predicted differences in Bosniak category assignments.</p><p><strong>Critical relevance statement: </strong>Contrast-enhanced US Bosniak classification reliably predicts malignancy in cystic renal masses, demonstrating substantial reproducibility and diagnostic accuracy. This improves clinical decision-making and patient management.</p><p><strong>Key points: </strong>Intra- and inter-rater reproducibility for contrast-enhance US features for Bosniak classification have not been well investigated. Substantial inter-rater agreements for the Bosniak category and variable agreements for determining imaging features were found. Contrast-enhanced US Bosniak classification is reproducible and has good diagnostic performance for predicting malignancy in cystic renal masses.</p>","PeriodicalId":13639,"journal":{"name":"Insights into Imaging","volume":"15 1","pages":"285"},"PeriodicalIF":4.1000,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11607359/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Insights into Imaging","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s13244-024-01858-7","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
Abstract
Background: The contrast-enhanced US (CEUS) Bosniak classification, proposed by the European Federation for Ultrasound in Medicine and Biology (EFSUMB) in 2020, predicts malignancy in cystic renal masses (CRMs). However, intra- and inter-rater reproducibility for CEUS features has not been well investigated.
Purpose: To explore intra- and inter-rater agreement for US features, identify confounding features, and assess the diagnostic performance of CEUS Bosniak classification.
Materials and methods: This retrospective study included patients with complex CRMs who underwent CEUS examination from January 2013 to August 2023. Radiologists (3 experts and 3 novices) evaluated calcification, echogenic content, wall, septa, and internal nodules of CRMs using CEUS Bosniak classification. Intra- and inter-rater agreements were assessed using the Gwet agreement coefficient (Gwet's AC). Linear regression identified features associated with discrepancies in Bosniak category assignment. Diagnostic performance was evaluated using the area under the receiver operating characteristic curve (AUC).
Results: A total of 103 complex CRMs were analyzed in 103 patients (mean age, 50 ± 15 years; 66 males). Intra-rater agreement for the Bosniak category was substantial to almost perfect (Gwet's AC 0.73-0.87). Inter-rater agreement was substantial for the Bosniak category (Gwet's AC 0.75) and moderate to almost perfect for US features (Gwet's AC 0.44-0.94). Nodule variation (i.e., absence vs. obtuse margin vs. acute margin) explained 84% of the variability in the Bosniak category assignment. CEUS Bosniak classification showed good diagnostic performance, with AUCs ranging from 0.78 to 0.90 for each rater.
Conclusions: CEUS Bosniak classification demonstrated substantial intra- and inter-rater reproducibility and good diagnostic performance in predicting the malignancy potential of CRMs. Nodule variations significantly predicted differences in Bosniak category assignments.
Critical relevance statement: Contrast-enhanced US Bosniak classification reliably predicts malignancy in cystic renal masses, demonstrating substantial reproducibility and diagnostic accuracy. This improves clinical decision-making and patient management.
Key points: Intra- and inter-rater reproducibility for contrast-enhance US features for Bosniak classification have not been well investigated. Substantial inter-rater agreements for the Bosniak category and variable agreements for determining imaging features were found. Contrast-enhanced US Bosniak classification is reproducible and has good diagnostic performance for predicting malignancy in cystic renal masses.
期刊介绍:
Insights into Imaging (I³) is a peer-reviewed open access journal published under the brand SpringerOpen. All content published in the journal is freely available online to anyone, anywhere!
I³ continuously updates scientific knowledge and progress in best-practice standards in radiology through the publication of original articles and state-of-the-art reviews and opinions, along with recommendations and statements from the leading radiological societies in Europe.
Founded by the European Society of Radiology (ESR), I³ creates a platform for educational material, guidelines and recommendations, and a forum for topics of controversy.
A balanced combination of review articles, original papers, short communications from European radiological congresses and information on society matters makes I³ an indispensable source for current information in this field.
I³ is owned by the ESR, however authors retain copyright to their article according to the Creative Commons Attribution License (see Copyright and License Agreement). All articles can be read, redistributed and reused for free, as long as the author of the original work is cited properly.
The open access fees (article-processing charges) for this journal are kindly sponsored by ESR for all Members.
The journal went open access in 2012, which means that all articles published since then are freely available online.