基于机器学习的冠状动脉内光学相干断层图像自动分割方法

Q4 Biochemistry, Genetics and Molecular Biology
Caining Zhang, Xiaoya Guo, D. Tang, D. Molony, Chun Yang, H. Samady, Jie Zheng, G. Mintz, A. Maehara, M. Matsumura, D. Giddens
{"title":"基于机器学习的冠状动脉内光学相干断层图像自动分割方法","authors":"Caining Zhang, Xiaoya Guo, D. Tang, D. Molony, Chun Yang, H. Samady, Jie Zheng, G. Mintz, A. Maehara, M. Matsumura, D. Giddens","doi":"10.32604/MCB.2019.05747","DOIUrl":null,"url":null,"abstract":"Cardiovascular diseases are closely associated with sudden rupture of atherosclerotic plaques. Previous image modalities such as magnetic resonance imaging (MRI) and intravascular ultrasound (IVUS) were unable to identify vulnerable plaques due to their limited resolution. Optical coherence tomography (OCT) is an advanced intravascular imaging technique developed in recent years which has high resolution approximately 10 microns and could provide more accurate morphology of coronary plaque. In particular, it is now possible to identify plaques with fibrous cap thickness < 65 µm, an accepted threshold value for vulnerable plaques.  However, the current segmentation of OCT images are still performed manually by physicians and the process is time consuming. Automatic segmentation and recognition of vulnerable plaques through quantification of plaque components have great clinical significance for cardiovascular research. Two segmentation methods for intracoronary OCT image based on support vector machine (SVM) and convolutional neural network (CNN) were performed to detect the lumen borders and characterize the plaque component. \nIn vivo IVUS and OCT coronary plaque data from 5 patients were acquired at Emory University with patient’s consent obtained. Seventy-seven matched IVUS and OCT slices with good image quality and medium to large lipid cores were selected for our segmentation study.  Manual OCT segmentation was performed by experts and used as gold standard in the automatic segmentations.  VH-IVUS was used as references and guide by the experts in the manual segmentation process.  Three plaque component tissue classes were identified from OCT images in this work: lipid tissue (LT), fibrous tissue (FT) and background (BG). Procedures using two machine learning methods (CNN and SVM) were developed to segment OCT images, respectively. For CNN method, the U-Net architecture was selected due to its good performance in very different biomedical segmentation and very few annotated images. For SVM method, local binary patterns (LBPs), gray level co-occurrence matrices (GLCMs) which contains contrast, correlation, energy and homogeneity, entropy and mean value were calculated as features and assembled to feed SVM classifier. The accuracies of two segmentation methods were evaluated and compared using the OCT dataset. Segmentation accuracy is defined as the ratio of the number of pixels correctly classified over the total number of pixels. \nThe overall classification accuracy based CNN method reached 95.8%, and the accuracies for LT, FT and BG were 86.8%, 83.4%, and 98.2%, respectively. The overall classification accuracy based SVM was 71.9%, and per-class accuracy for LT, FT and BG was 75.4%, 78.3%, and 67.0%, respectively. \nThe two methods proposed can automatically detect the lumen borders and characterize the composition of the superficial plaque in OCT images and greatly reduce the time spent by doctors in segmenting and identifying plaques.  CNN provided better segmentation accuracies compared to those achieved by SVM. \nAcknowledgement: This research was supported in part by NIH grant R01 EB004759, National Sciences Foundation of China grant 11672001 and a Jiangsu Province Science and Technology Agency grant BE2016785.","PeriodicalId":48719,"journal":{"name":"Molecular & Cellular Biomechanics","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2019-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Automatic Segmentation Methods Based on Machine Learning for Intracoronary Optical Coherence Tomography Image\",\"authors\":\"Caining Zhang, Xiaoya Guo, D. Tang, D. Molony, Chun Yang, H. Samady, Jie Zheng, G. Mintz, A. Maehara, M. Matsumura, D. Giddens\",\"doi\":\"10.32604/MCB.2019.05747\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Cardiovascular diseases are closely associated with sudden rupture of atherosclerotic plaques. Previous image modalities such as magnetic resonance imaging (MRI) and intravascular ultrasound (IVUS) were unable to identify vulnerable plaques due to their limited resolution. Optical coherence tomography (OCT) is an advanced intravascular imaging technique developed in recent years which has high resolution approximately 10 microns and could provide more accurate morphology of coronary plaque. In particular, it is now possible to identify plaques with fibrous cap thickness < 65 µm, an accepted threshold value for vulnerable plaques.  However, the current segmentation of OCT images are still performed manually by physicians and the process is time consuming. Automatic segmentation and recognition of vulnerable plaques through quantification of plaque components have great clinical significance for cardiovascular research. Two segmentation methods for intracoronary OCT image based on support vector machine (SVM) and convolutional neural network (CNN) were performed to detect the lumen borders and characterize the plaque component. \\nIn vivo IVUS and OCT coronary plaque data from 5 patients were acquired at Emory University with patient’s consent obtained. Seventy-seven matched IVUS and OCT slices with good image quality and medium to large lipid cores were selected for our segmentation study.  Manual OCT segmentation was performed by experts and used as gold standard in the automatic segmentations.  VH-IVUS was used as references and guide by the experts in the manual segmentation process.  Three plaque component tissue classes were identified from OCT images in this work: lipid tissue (LT), fibrous tissue (FT) and background (BG). Procedures using two machine learning methods (CNN and SVM) were developed to segment OCT images, respectively. For CNN method, the U-Net architecture was selected due to its good performance in very different biomedical segmentation and very few annotated images. For SVM method, local binary patterns (LBPs), gray level co-occurrence matrices (GLCMs) which contains contrast, correlation, energy and homogeneity, entropy and mean value were calculated as features and assembled to feed SVM classifier. The accuracies of two segmentation methods were evaluated and compared using the OCT dataset. Segmentation accuracy is defined as the ratio of the number of pixels correctly classified over the total number of pixels. \\nThe overall classification accuracy based CNN method reached 95.8%, and the accuracies for LT, FT and BG were 86.8%, 83.4%, and 98.2%, respectively. The overall classification accuracy based SVM was 71.9%, and per-class accuracy for LT, FT and BG was 75.4%, 78.3%, and 67.0%, respectively. \\nThe two methods proposed can automatically detect the lumen borders and characterize the composition of the superficial plaque in OCT images and greatly reduce the time spent by doctors in segmenting and identifying plaques.  CNN provided better segmentation accuracies compared to those achieved by SVM. \\nAcknowledgement: This research was supported in part by NIH grant R01 EB004759, National Sciences Foundation of China grant 11672001 and a Jiangsu Province Science and Technology Agency grant BE2016785.\",\"PeriodicalId\":48719,\"journal\":{\"name\":\"Molecular & Cellular Biomechanics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-02-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Molecular & Cellular Biomechanics\",\"FirstCategoryId\":\"1087\",\"ListUrlMain\":\"https://doi.org/10.32604/MCB.2019.05747\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Biochemistry, Genetics and Molecular Biology\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Molecular & Cellular Biomechanics","FirstCategoryId":"1087","ListUrlMain":"https://doi.org/10.32604/MCB.2019.05747","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Biochemistry, Genetics and Molecular Biology","Score":null,"Total":0}
引用次数: 1

摘要

心血管疾病与动脉粥样硬化斑块的突然破裂密切相关。以前的成像方式,如磁共振成像(MRI)和血管内超声(IVUS)由于分辨率有限,无法识别易损斑块。光学相干断层扫描(OCT)是近年来发展起来的一种先进的血管内成像技术,其分辨率约为10微米,可以提供更准确的冠状动脉斑块形态。特别是,现在可以识别纤维帽厚度< 65µm的斑块,这是易损斑块的公认阈值。然而,目前的OCT图像分割仍然是由医生手动执行的,而且这个过程非常耗时。通过对易损斑块成分的量化,对易损斑块进行自动分割和识别,对心血管研究具有重要的临床意义。采用基于支持向量机(SVM)和卷积神经网络(CNN)的冠状动脉内OCT图像分割方法检测管腔边界,表征斑块成分。5例患者的体内IVUS和OCT冠状动脉斑块数据在获得患者同意后在Emory大学获得。选取77张影像质量良好、脂质核大小适中的IVUS和OCT切片进行分割研究。人工OCT分割由专家完成,并作为自动分割的金标准。VH-IVUS作为人工分割的参考和指导。本研究从OCT图像中确定了三种斑块组成组织:脂质组织(LT)、纤维组织(FT)和背景组织(BG)。分别使用CNN和SVM两种机器学习方法对OCT图像进行分割。对于CNN方法,由于U-Net架构在非常不同的生物医学分割中具有良好的性能,并且注释的图像很少,因此选择U-Net架构。支持向量机方法将局部二值模式(lbp)、包含对比度、相关性、能量和均匀性的灰度共生矩阵(glcm)、熵和均值作为特征进行计算,并将其组合到支持向量机分类器中。使用OCT数据集对两种分割方法的准确率进行了评估和比较。分割精度定义为正确分类的像素数与总像素数之比。基于CNN的分类方法总体准确率达到95.8%,其中LT、FT和BG的准确率分别为86.8%、83.4%和98.2%。基于SVM的总体分类准确率为71.9%,其中LT、FT和BG的分类准确率分别为75.4%、78.3%和67.0%。所提出的两种方法可以在OCT图像中自动检测腔腔边界和表征表面斑块的组成,大大减少了医生分割和识别斑块的时间。与SVM相比,CNN提供了更好的分割精度。致谢:本研究得到了美国国立卫生研究院资助项目R01 EB004759,中国国家科学基金资助项目11672001和江苏省科技厅资助项目BE2016785的部分支持。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Automatic Segmentation Methods Based on Machine Learning for Intracoronary Optical Coherence Tomography Image
Cardiovascular diseases are closely associated with sudden rupture of atherosclerotic plaques. Previous image modalities such as magnetic resonance imaging (MRI) and intravascular ultrasound (IVUS) were unable to identify vulnerable plaques due to their limited resolution. Optical coherence tomography (OCT) is an advanced intravascular imaging technique developed in recent years which has high resolution approximately 10 microns and could provide more accurate morphology of coronary plaque. In particular, it is now possible to identify plaques with fibrous cap thickness < 65 µm, an accepted threshold value for vulnerable plaques.  However, the current segmentation of OCT images are still performed manually by physicians and the process is time consuming. Automatic segmentation and recognition of vulnerable plaques through quantification of plaque components have great clinical significance for cardiovascular research. Two segmentation methods for intracoronary OCT image based on support vector machine (SVM) and convolutional neural network (CNN) were performed to detect the lumen borders and characterize the plaque component. In vivo IVUS and OCT coronary plaque data from 5 patients were acquired at Emory University with patient’s consent obtained. Seventy-seven matched IVUS and OCT slices with good image quality and medium to large lipid cores were selected for our segmentation study.  Manual OCT segmentation was performed by experts and used as gold standard in the automatic segmentations.  VH-IVUS was used as references and guide by the experts in the manual segmentation process.  Three plaque component tissue classes were identified from OCT images in this work: lipid tissue (LT), fibrous tissue (FT) and background (BG). Procedures using two machine learning methods (CNN and SVM) were developed to segment OCT images, respectively. For CNN method, the U-Net architecture was selected due to its good performance in very different biomedical segmentation and very few annotated images. For SVM method, local binary patterns (LBPs), gray level co-occurrence matrices (GLCMs) which contains contrast, correlation, energy and homogeneity, entropy and mean value were calculated as features and assembled to feed SVM classifier. The accuracies of two segmentation methods were evaluated and compared using the OCT dataset. Segmentation accuracy is defined as the ratio of the number of pixels correctly classified over the total number of pixels. The overall classification accuracy based CNN method reached 95.8%, and the accuracies for LT, FT and BG were 86.8%, 83.4%, and 98.2%, respectively. The overall classification accuracy based SVM was 71.9%, and per-class accuracy for LT, FT and BG was 75.4%, 78.3%, and 67.0%, respectively. The two methods proposed can automatically detect the lumen borders and characterize the composition of the superficial plaque in OCT images and greatly reduce the time spent by doctors in segmenting and identifying plaques.  CNN provided better segmentation accuracies compared to those achieved by SVM. Acknowledgement: This research was supported in part by NIH grant R01 EB004759, National Sciences Foundation of China grant 11672001 and a Jiangsu Province Science and Technology Agency grant BE2016785.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Molecular & Cellular Biomechanics
Molecular & Cellular Biomechanics CELL BIOLOGYENGINEERING, BIOMEDICAL&-ENGINEERING, BIOMEDICAL
CiteScore
1.70
自引率
0.00%
发文量
21
期刊介绍: The field of biomechanics concerns with motion, deformation, and forces in biological systems. With the explosive progress in molecular biology, genomic engineering, bioimaging, and nanotechnology, there will be an ever-increasing generation of knowledge and information concerning the mechanobiology of genes, proteins, cells, tissues, and organs. Such information will bring new diagnostic tools, new therapeutic approaches, and new knowledge on ourselves and our interactions with our environment. It becomes apparent that biomechanics focusing on molecules, cells as well as tissues and organs is an important aspect of modern biomedical sciences. The aims of this journal are to facilitate the studies of the mechanics of biomolecules (including proteins, genes, cytoskeletons, etc.), cells (and their interactions with extracellular matrix), tissues and organs, the development of relevant advanced mathematical methods, and the discovery of biological secrets. As science concerns only with relative truth, we seek ideas that are state-of-the-art, which may be controversial, but stimulate and promote new ideas, new techniques, and new applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信