CLEAR guideline for radiomics: Early insights into current reporting practices endorsed by EuSoMII

IF 3.2 3区医学 Q1 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING

European Journal of Radiology Pub Date : 2024-10-14 DOI:10.1016/j.ejrad.2024.111788

Burak Kocak , Andrea Ponsiglione , Arnaldo Stanzione , Lorenzo Ugga , Michail E. Klontzas , Roberto Cannella , Renato Cuocolo

{"title":"CLEAR guideline for radiomics: Early insights into current reporting practices endorsed by EuSoMII","authors":"Burak Kocak , Andrea Ponsiglione , Arnaldo Stanzione , Lorenzo Ugga , Michail E. Klontzas , Roberto Cannella , Renato Cuocolo","doi":"10.1016/j.ejrad.2024.111788","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><div>This study aims to evaluate current reporting practices in radiomics research, with a focus on CheckList for EvaluAtion of Radiomics research (CLEAR).</div></div><div><h3>Methods</h3><div>We conducted a citation search using Google Scholar to collect original research articles on radiomics citing the CLEAR guideline up to June 17, 2024. We examined the adoption of the guideline, adherence scores per publication, item-wise adherence rates, and self-reporting practices. An expert panel from the European Society of Medical Imaging Informatics Radiomics Auditing Group conducted a detailed item-by-item confirmation analysis of the self-reported CLEAR checklists.</div></div><div><h3>Results</h3><div>Out of 100 unique citations from 104 records, 48 original research papers on radiomics were included. The overall adoption rate in the literature was 2 %. Among the citing articles, 94 % (45/48) adopted CLEAR for reporting purposes, applying it to both hand-crafted radiomics (89 %) and deep learning (24 %). Self-reported checklists were included in 58 % (26/45) of these papers. Median study-wise adherence score for self-reported data was 91 % (interquartile range = 18 %). Mean confirmed adherence score was 66 % (standard deviation = 14 %). Difference between these scores was statistically significant, (mean = 21 %; standard deviation = 11 %), p < 0.001. Using an arbitrary 50 % adherence cut-off, the number of items with poor adherence increased from 3 to 15 after confirmation analysis, mostly comprised of open science-related items. In addition, several items were frequently misreported.</div></div><div><h3>Conclusion</h3><div>This study revealed significant discrepancies between self-reported and confirmed adherence to the CLEAR guideline in radiomics research, indicating a need for improved reporting accuracy and verification practices.</div></div>","PeriodicalId":12063,"journal":{"name":"European Journal of Radiology","volume":"181 ","pages":"Article 111788"},"PeriodicalIF":3.2000,"publicationDate":"2024-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Journal of Radiology","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0720048X24005047","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}

引用次数: 0

Abstract

Purpose

This study aims to evaluate current reporting practices in radiomics research, with a focus on CheckList for EvaluAtion of Radiomics research (CLEAR).

Methods

We conducted a citation search using Google Scholar to collect original research articles on radiomics citing the CLEAR guideline up to June 17, 2024. We examined the adoption of the guideline, adherence scores per publication, item-wise adherence rates, and self-reporting practices. An expert panel from the European Society of Medical Imaging Informatics Radiomics Auditing Group conducted a detailed item-by-item confirmation analysis of the self-reported CLEAR checklists.

Results

Out of 100 unique citations from 104 records, 48 original research papers on radiomics were included. The overall adoption rate in the literature was 2 %. Among the citing articles, 94 % (45/48) adopted CLEAR for reporting purposes, applying it to both hand-crafted radiomics (89 %) and deep learning (24 %). Self-reported checklists were included in 58 % (26/45) of these papers. Median study-wise adherence score for self-reported data was 91 % (interquartile range = 18 %). Mean confirmed adherence score was 66 % (standard deviation = 14 %). Difference between these scores was statistically significant, (mean = 21 %; standard deviation = 11 %), p < 0.001. Using an arbitrary 50 % adherence cut-off, the number of items with poor adherence increased from 3 to 15 after confirmation analysis, mostly comprised of open science-related items. In addition, several items were frequently misreported.

Conclusion

This study revealed significant discrepancies between self-reported and confirmed adherence to the CLEAR guideline in radiomics research, indicating a need for improved reporting accuracy and verification practices.

查看原文本刊更多论文

放射组学 CLEAR 准则：EuSoMII 批准的当前报告实践的初步见解。

目的：本研究旨在评估当前放射组学研究的报告实践，重点是放射组学研究评估清单（CLEAR）：我们使用谷歌学术（Google Scholar）进行了引文检索，收集了截至2024年6月17日引用CLEAR指南的放射组学原创研究文章。我们研究了该指南的采用情况、每篇出版物的遵守得分、项目遵守率以及自我报告实践。欧洲医学影像信息学会放射组学审核小组的专家小组对自我报告的 CLEAR 核对表进行了详细的逐项确认分析：在 104 条记录的 100 条唯一引用中，有 48 篇关于放射组学的原创研究论文被收录。文献的总体采用率为 2%。在被引用的文章中，94%（45/48）采用 CLEAR 进行报告，将其应用于手工制作的放射组学（89%）和深度学习（24%）。在这些论文中，58%（26/45）的论文采用了自我报告核对表。自我报告数据的研究一致性得分中位数为 91%（四分位间范围 = 18%）。经确认的依从性得分中位数为 66%（标准差 = 14%）。这些分数之间的差异具有统计学意义（平均 = 21%；标准差 = 11%），p 结论：本研究显示，在放射组学研究中，自我报告与确认遵守 CLEAR 准则之间存在重大差异，表明需要提高报告准确性并改进验证方法。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

European Journal of Radiology 医学-核医学

CiteScore

6.70

自引率

3.00%

发文量

398

审稿时长

42 days

期刊介绍： European Journal of Radiology is an international journal which aims to communicate to its readers, state-of-the-art information on imaging developments in the form of high quality original research articles and timely reviews on current developments in the field. Its audience includes clinicians at all levels of training including radiology trainees, newly qualified imaging specialists and the experienced radiologist. Its aim is to inform efficient, appropriate and evidence-based imaging practice to the benefit of patients worldwide.