An innovative annotation tool for selecting Regions of Interest (ROI) in contrast-enhanced imaging ultrasonography (CEUS) of Hepatocellular carcinoma (HCC)

IF 4 3区 医学 Q1 GASTROENTEROLOGY & HEPATOLOGY
{"title":"An innovative annotation tool for selecting Regions of Interest (ROI) in contrast-enhanced imaging ultrasonography (CEUS) of Hepatocellular carcinoma (HCC)","authors":"","doi":"10.1016/j.dld.2024.08.028","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><p>CEUS is a safe and cost-effective imaging technique which allows a real-time evaluation of focal liver lesions (FLL). It has become a fundamental tool in HCC surveillance and diagnosis. Nevertheless, some concerns have risen in the past on its diagnostic accuracy, in particular in its ability to discriminate between HCC and small (&lt;3 cm) Intraepatic cholangio-Carcinoma (ICC). Recent advances in AI-driven tools for medical imaging have demonstrated the potential of greatly improving accuracy. In ultrasonography, they have been proposed to perform diagnosis from CEUS images alone or in combination with Bi-modal ones: the former can provide information about the contrast pattern; the latter enhances structural characteristics.Two challenges arise in the use of machine learning in the analysis of liver ultrasound images. First, the lack of large public datasets, which makes it difficult to train deep learning models, capable of extracting powerful features, optimized for the task: Radiomics, represents an effective technique for extracting powerful quantitative features without the need of a training dataset. Second, the need for complete and standardized annotations, crucial for effective model training.</p></div><div><h3>Aims</h3><p>To build an annotation software capable of selecting ROIs in CEUS imaging and of extracting Radiomics features from both CEUS and B-Mode views, with the intention to build an automated detection software protocol for FLL diagnosis.</p></div><div><h3>Methods</h3><p>A stand-alone tool for annotating CEUS exams and extracting Radiomics features from the annotated ROIs is proposed. It inputs a CEUS exam stored in a WMV or a DICOM file, which includes both B-mode and CEUS views in split screen manner. It allows the radiologist to select the more suitable frame to be annotated within the exam. Two automatisms are introduced in the annotation procedure: first, the tool is capable of replicating in real-time the annotation performed by the annotator on one view, onto the other one. In addition, it is capable of automatically interpolating contour points of the lesion, in case the annotator will not perform a complete annotation. Once annotation is performed, both annotated CEUS and B-Mode views are prepared for labeling and feature extraction. Labeling concerns both the selection of the phase the frame belongs to, i.e., arterial, portal or late, and the type of annotated lesion. Feature extraction instead is performed through Radiomics: to this aim, the annotated views are automatically saved into two distinct NifTI files, from which histogram-based, shape-based and texture based Radiomics features are automatically extracted through PyRadiomics and saved into a specific folder for that exam. A total number of 102 features are automatically extracted and saved from each view.</p></div><div><h3>Results</h3><p>The proposed tool has been positively evaluated by radiologists from the University of Salerno, because of its ease of use and its ability to automatically reproduce on one view, the annotations manually made on the other one.</p></div><div><h3>Conclusions</h3><p>In this work, a stand-alone tool for annotating multi-view liver ultrasound images is proposed. The next step is to use it to create a complete labeled dataset exploitable by AI methods from single or multi view liver lesion analysis.</p></div>","PeriodicalId":11268,"journal":{"name":"Digestive and Liver Disease","volume":null,"pages":null},"PeriodicalIF":4.0000,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digestive and Liver Disease","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1590865824009472","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GASTROENTEROLOGY & HEPATOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Introduction

CEUS is a safe and cost-effective imaging technique which allows a real-time evaluation of focal liver lesions (FLL). It has become a fundamental tool in HCC surveillance and diagnosis. Nevertheless, some concerns have risen in the past on its diagnostic accuracy, in particular in its ability to discriminate between HCC and small (<3 cm) Intraepatic cholangio-Carcinoma (ICC). Recent advances in AI-driven tools for medical imaging have demonstrated the potential of greatly improving accuracy. In ultrasonography, they have been proposed to perform diagnosis from CEUS images alone or in combination with Bi-modal ones: the former can provide information about the contrast pattern; the latter enhances structural characteristics.Two challenges arise in the use of machine learning in the analysis of liver ultrasound images. First, the lack of large public datasets, which makes it difficult to train deep learning models, capable of extracting powerful features, optimized for the task: Radiomics, represents an effective technique for extracting powerful quantitative features without the need of a training dataset. Second, the need for complete and standardized annotations, crucial for effective model training.

Aims

To build an annotation software capable of selecting ROIs in CEUS imaging and of extracting Radiomics features from both CEUS and B-Mode views, with the intention to build an automated detection software protocol for FLL diagnosis.

Methods

A stand-alone tool for annotating CEUS exams and extracting Radiomics features from the annotated ROIs is proposed. It inputs a CEUS exam stored in a WMV or a DICOM file, which includes both B-mode and CEUS views in split screen manner. It allows the radiologist to select the more suitable frame to be annotated within the exam. Two automatisms are introduced in the annotation procedure: first, the tool is capable of replicating in real-time the annotation performed by the annotator on one view, onto the other one. In addition, it is capable of automatically interpolating contour points of the lesion, in case the annotator will not perform a complete annotation. Once annotation is performed, both annotated CEUS and B-Mode views are prepared for labeling and feature extraction. Labeling concerns both the selection of the phase the frame belongs to, i.e., arterial, portal or late, and the type of annotated lesion. Feature extraction instead is performed through Radiomics: to this aim, the annotated views are automatically saved into two distinct NifTI files, from which histogram-based, shape-based and texture based Radiomics features are automatically extracted through PyRadiomics and saved into a specific folder for that exam. A total number of 102 features are automatically extracted and saved from each view.

Results

The proposed tool has been positively evaluated by radiologists from the University of Salerno, because of its ease of use and its ability to automatically reproduce on one view, the annotations manually made on the other one.

Conclusions

In this work, a stand-alone tool for annotating multi-view liver ultrasound images is proposed. The next step is to use it to create a complete labeled dataset exploitable by AI methods from single or multi view liver lesion analysis.

用于在肝细胞癌(HCC)对比增强超声成像(CEUS)中选择感兴趣区(ROI)的创新注释工具
导言CEUS是一种安全、经济的成像技术,可对肝脏病灶(FLL)进行实时评估。它已成为监测和诊断 HCC 的基本工具。然而,过去人们对它的诊断准确性提出了一些担忧,特别是它区分 HCC 和小的(3 厘米)肝内胆管癌(ICC)的能力。医学影像人工智能驱动工具的最新进展表明,它有可能大大提高准确性。在超声造影领域,有人提出利用这些工具单独或结合双模态 CEUS 图像进行诊断:前者可提供有关对比度模式的信息;后者可增强结构特征。首先,由于缺乏大型公共数据集,因此很难训练能够提取强大特征并针对任务进行优化的深度学习模型:放射组学是一种无需训练数据集即可提取强大定量特征的有效技术。Aims To build an annotation software capable of selecting ROIs in CEUS imaging and of extracting Radiomics features from both CEUS and B-Mode views, with the intention to build an automated detection software protocol for FLL diagnosis.Methods A stand-one tool for annotating CEUS exams and extracting Radiomics features from the annotated ROIs is proposed.它输入以 WMV 或 DICOM 文件格式存储的 CEUS 检查,其中包括分屏方式的 B 模式和 CEUS 视图。它允许放射科医生在检查中选择更合适的帧进行注释。在注释过程中引入了两个自动功能:首先,该工具能够将注释者在一个视图上进行的注释实时复制到另一个视图上。此外,该工具还能自动插值病变轮廓点,以防标注者无法进行完整标注。标注完成后,标注过的 CEUS 和 B-Mode 视图将用于标记和特征提取。标注既涉及帧所属阶段的选择,即动脉、门脉或晚期,也涉及标注病变的类型。特征提取则是通过放射组学进行的:为此,标注的视图会自动保存到两个不同的 NifTI 文件中,然后通过 PyRadiomics 从中自动提取基于直方图、形状和纹理的放射组学特征,并保存到该检查的特定文件夹中。从每个视图中自动提取并保存了总共 102 个特征。结果萨莱诺大学的放射科医生对所提出的工具给予了积极评价,因为它易于使用,而且能够在一个视图上自动复制在另一个视图上手动做出的注释。下一步是利用它创建一个完整的标记数据集,供人工智能方法从单个或多个视图分析肝脏病变。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Digestive and Liver Disease
Digestive and Liver Disease 医学-胃肠肝病学
CiteScore
6.10
自引率
2.20%
发文量
632
审稿时长
19 days
期刊介绍: Digestive and Liver Disease is an international journal of Gastroenterology and Hepatology. It is the official journal of Italian Association for the Study of the Liver (AISF); Italian Association for the Study of the Pancreas (AISP); Italian Association for Digestive Endoscopy (SIED); Italian Association for Hospital Gastroenterologists and Digestive Endoscopists (AIGO); Italian Society of Gastroenterology (SIGE); Italian Society of Pediatric Gastroenterology and Hepatology (SIGENP) and Italian Group for the Study of Inflammatory Bowel Disease (IG-IBD). Digestive and Liver Disease publishes papers on basic and clinical research in the field of gastroenterology and hepatology. Contributions consist of: Original Papers Correspondence to the Editor Editorials, Reviews and Special Articles Progress Reports Image of the Month Congress Proceedings Symposia and Mini-symposia.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信