An innovative annotation tool for selecting Regions of Interest (ROI) in contrast-enhanced imaging ultrasonography (CEUS) of Hepatocellular carcinoma (HCC)
{"title":"An innovative annotation tool for selecting Regions of Interest (ROI) in contrast-enhanced imaging ultrasonography (CEUS) of Hepatocellular carcinoma (HCC)","authors":"","doi":"10.1016/j.dld.2024.08.028","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><p>CEUS is a safe and cost-effective imaging technique which allows a real-time evaluation of focal liver lesions (FLL). It has become a fundamental tool in HCC surveillance and diagnosis. Nevertheless, some concerns have risen in the past on its diagnostic accuracy, in particular in its ability to discriminate between HCC and small (<3 cm) Intraepatic cholangio-Carcinoma (ICC). Recent advances in AI-driven tools for medical imaging have demonstrated the potential of greatly improving accuracy. In ultrasonography, they have been proposed to perform diagnosis from CEUS images alone or in combination with Bi-modal ones: the former can provide information about the contrast pattern; the latter enhances structural characteristics.Two challenges arise in the use of machine learning in the analysis of liver ultrasound images. First, the lack of large public datasets, which makes it difficult to train deep learning models, capable of extracting powerful features, optimized for the task: Radiomics, represents an effective technique for extracting powerful quantitative features without the need of a training dataset. Second, the need for complete and standardized annotations, crucial for effective model training.</p></div><div><h3>Aims</h3><p>To build an annotation software capable of selecting ROIs in CEUS imaging and of extracting Radiomics features from both CEUS and B-Mode views, with the intention to build an automated detection software protocol for FLL diagnosis.</p></div><div><h3>Methods</h3><p>A stand-alone tool for annotating CEUS exams and extracting Radiomics features from the annotated ROIs is proposed. It inputs a CEUS exam stored in a WMV or a DICOM file, which includes both B-mode and CEUS views in split screen manner. It allows the radiologist to select the more suitable frame to be annotated within the exam. Two automatisms are introduced in the annotation procedure: first, the tool is capable of replicating in real-time the annotation performed by the annotator on one view, onto the other one. In addition, it is capable of automatically interpolating contour points of the lesion, in case the annotator will not perform a complete annotation. Once annotation is performed, both annotated CEUS and B-Mode views are prepared for labeling and feature extraction. Labeling concerns both the selection of the phase the frame belongs to, i.e., arterial, portal or late, and the type of annotated lesion. Feature extraction instead is performed through Radiomics: to this aim, the annotated views are automatically saved into two distinct NifTI files, from which histogram-based, shape-based and texture based Radiomics features are automatically extracted through PyRadiomics and saved into a specific folder for that exam. A total number of 102 features are automatically extracted and saved from each view.</p></div><div><h3>Results</h3><p>The proposed tool has been positively evaluated by radiologists from the University of Salerno, because of its ease of use and its ability to automatically reproduce on one view, the annotations manually made on the other one.</p></div><div><h3>Conclusions</h3><p>In this work, a stand-alone tool for annotating multi-view liver ultrasound images is proposed. The next step is to use it to create a complete labeled dataset exploitable by AI methods from single or multi view liver lesion analysis.</p></div>","PeriodicalId":11268,"journal":{"name":"Digestive and Liver Disease","volume":null,"pages":null},"PeriodicalIF":4.0000,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digestive and Liver Disease","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1590865824009472","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GASTROENTEROLOGY & HEPATOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Introduction
CEUS is a safe and cost-effective imaging technique which allows a real-time evaluation of focal liver lesions (FLL). It has become a fundamental tool in HCC surveillance and diagnosis. Nevertheless, some concerns have risen in the past on its diagnostic accuracy, in particular in its ability to discriminate between HCC and small (<3 cm) Intraepatic cholangio-Carcinoma (ICC). Recent advances in AI-driven tools for medical imaging have demonstrated the potential of greatly improving accuracy. In ultrasonography, they have been proposed to perform diagnosis from CEUS images alone or in combination with Bi-modal ones: the former can provide information about the contrast pattern; the latter enhances structural characteristics.Two challenges arise in the use of machine learning in the analysis of liver ultrasound images. First, the lack of large public datasets, which makes it difficult to train deep learning models, capable of extracting powerful features, optimized for the task: Radiomics, represents an effective technique for extracting powerful quantitative features without the need of a training dataset. Second, the need for complete and standardized annotations, crucial for effective model training.
Aims
To build an annotation software capable of selecting ROIs in CEUS imaging and of extracting Radiomics features from both CEUS and B-Mode views, with the intention to build an automated detection software protocol for FLL diagnosis.
Methods
A stand-alone tool for annotating CEUS exams and extracting Radiomics features from the annotated ROIs is proposed. It inputs a CEUS exam stored in a WMV or a DICOM file, which includes both B-mode and CEUS views in split screen manner. It allows the radiologist to select the more suitable frame to be annotated within the exam. Two automatisms are introduced in the annotation procedure: first, the tool is capable of replicating in real-time the annotation performed by the annotator on one view, onto the other one. In addition, it is capable of automatically interpolating contour points of the lesion, in case the annotator will not perform a complete annotation. Once annotation is performed, both annotated CEUS and B-Mode views are prepared for labeling and feature extraction. Labeling concerns both the selection of the phase the frame belongs to, i.e., arterial, portal or late, and the type of annotated lesion. Feature extraction instead is performed through Radiomics: to this aim, the annotated views are automatically saved into two distinct NifTI files, from which histogram-based, shape-based and texture based Radiomics features are automatically extracted through PyRadiomics and saved into a specific folder for that exam. A total number of 102 features are automatically extracted and saved from each view.
Results
The proposed tool has been positively evaluated by radiologists from the University of Salerno, because of its ease of use and its ability to automatically reproduce on one view, the annotations manually made on the other one.
Conclusions
In this work, a stand-alone tool for annotating multi-view liver ultrasound images is proposed. The next step is to use it to create a complete labeled dataset exploitable by AI methods from single or multi view liver lesion analysis.
导言CEUS是一种安全、经济的成像技术,可对肝脏病灶(FLL)进行实时评估。它已成为监测和诊断 HCC 的基本工具。然而,过去人们对它的诊断准确性提出了一些担忧,特别是它区分 HCC 和小的(3 厘米)肝内胆管癌(ICC)的能力。医学影像人工智能驱动工具的最新进展表明,它有可能大大提高准确性。在超声造影领域,有人提出利用这些工具单独或结合双模态 CEUS 图像进行诊断:前者可提供有关对比度模式的信息;后者可增强结构特征。首先,由于缺乏大型公共数据集,因此很难训练能够提取强大特征并针对任务进行优化的深度学习模型:放射组学是一种无需训练数据集即可提取强大定量特征的有效技术。Aims To build an annotation software capable of selecting ROIs in CEUS imaging and of extracting Radiomics features from both CEUS and B-Mode views, with the intention to build an automated detection software protocol for FLL diagnosis.Methods A stand-one tool for annotating CEUS exams and extracting Radiomics features from the annotated ROIs is proposed.它输入以 WMV 或 DICOM 文件格式存储的 CEUS 检查,其中包括分屏方式的 B 模式和 CEUS 视图。它允许放射科医生在检查中选择更合适的帧进行注释。在注释过程中引入了两个自动功能:首先,该工具能够将注释者在一个视图上进行的注释实时复制到另一个视图上。此外,该工具还能自动插值病变轮廓点,以防标注者无法进行完整标注。标注完成后,标注过的 CEUS 和 B-Mode 视图将用于标记和特征提取。标注既涉及帧所属阶段的选择,即动脉、门脉或晚期,也涉及标注病变的类型。特征提取则是通过放射组学进行的:为此,标注的视图会自动保存到两个不同的 NifTI 文件中,然后通过 PyRadiomics 从中自动提取基于直方图、形状和纹理的放射组学特征,并保存到该检查的特定文件夹中。从每个视图中自动提取并保存了总共 102 个特征。结果萨莱诺大学的放射科医生对所提出的工具给予了积极评价,因为它易于使用,而且能够在一个视图上自动复制在另一个视图上手动做出的注释。下一步是利用它创建一个完整的标记数据集,供人工智能方法从单个或多个视图分析肝脏病变。
期刊介绍:
Digestive and Liver Disease is an international journal of Gastroenterology and Hepatology. It is the official journal of Italian Association for the Study of the Liver (AISF); Italian Association for the Study of the Pancreas (AISP); Italian Association for Digestive Endoscopy (SIED); Italian Association for Hospital Gastroenterologists and Digestive Endoscopists (AIGO); Italian Society of Gastroenterology (SIGE); Italian Society of Pediatric Gastroenterology and Hepatology (SIGENP) and Italian Group for the Study of Inflammatory Bowel Disease (IG-IBD).
Digestive and Liver Disease publishes papers on basic and clinical research in the field of gastroenterology and hepatology.
Contributions consist of:
Original Papers
Correspondence to the Editor
Editorials, Reviews and Special Articles
Progress Reports
Image of the Month
Congress Proceedings
Symposia and Mini-symposia.