Caining Zhang, Xiaoya Guo, D. Tang, D. Molony, Chun Yang, H. Samady, Jie Zheng, G. Mintz, A. Maehara, M. Matsumura, D. Giddens
{"title":"基于机器学习的冠状动脉内光学相干断层图像自动分割方法","authors":"Caining Zhang, Xiaoya Guo, D. Tang, D. Molony, Chun Yang, H. Samady, Jie Zheng, G. Mintz, A. Maehara, M. Matsumura, D. Giddens","doi":"10.32604/MCB.2019.05747","DOIUrl":null,"url":null,"abstract":"Cardiovascular diseases are closely associated with sudden rupture of atherosclerotic plaques. Previous image modalities such as magnetic resonance imaging (MRI) and intravascular ultrasound (IVUS) were unable to identify vulnerable plaques due to their limited resolution. Optical coherence tomography (OCT) is an advanced intravascular imaging technique developed in recent years which has high resolution approximately 10 microns and could provide more accurate morphology of coronary plaque. In particular, it is now possible to identify plaques with fibrous cap thickness < 65 µm, an accepted threshold value for vulnerable plaques. However, the current segmentation of OCT images are still performed manually by physicians and the process is time consuming. Automatic segmentation and recognition of vulnerable plaques through quantification of plaque components have great clinical significance for cardiovascular research. Two segmentation methods for intracoronary OCT image based on support vector machine (SVM) and convolutional neural network (CNN) were performed to detect the lumen borders and characterize the plaque component. \nIn vivo IVUS and OCT coronary plaque data from 5 patients were acquired at Emory University with patient’s consent obtained. Seventy-seven matched IVUS and OCT slices with good image quality and medium to large lipid cores were selected for our segmentation study. Manual OCT segmentation was performed by experts and used as gold standard in the automatic segmentations. VH-IVUS was used as references and guide by the experts in the manual segmentation process. Three plaque component tissue classes were identified from OCT images in this work: lipid tissue (LT), fibrous tissue (FT) and background (BG). Procedures using two machine learning methods (CNN and SVM) were developed to segment OCT images, respectively. For CNN method, the U-Net architecture was selected due to its good performance in very different biomedical segmentation and very few annotated images. For SVM method, local binary patterns (LBPs), gray level co-occurrence matrices (GLCMs) which contains contrast, correlation, energy and homogeneity, entropy and mean value were calculated as features and assembled to feed SVM classifier. The accuracies of two segmentation methods were evaluated and compared using the OCT dataset. Segmentation accuracy is defined as the ratio of the number of pixels correctly classified over the total number of pixels. \nThe overall classification accuracy based CNN method reached 95.8%, and the accuracies for LT, FT and BG were 86.8%, 83.4%, and 98.2%, respectively. The overall classification accuracy based SVM was 71.9%, and per-class accuracy for LT, FT and BG was 75.4%, 78.3%, and 67.0%, respectively. \nThe two methods proposed can automatically detect the lumen borders and characterize the composition of the superficial plaque in OCT images and greatly reduce the time spent by doctors in segmenting and identifying plaques. CNN provided better segmentation accuracies compared to those achieved by SVM. \nAcknowledgement: This research was supported in part by NIH grant R01 EB004759, National Sciences Foundation of China grant 11672001 and a Jiangsu Province Science and Technology Agency grant BE2016785.","PeriodicalId":48719,"journal":{"name":"Molecular & Cellular Biomechanics","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2019-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Automatic Segmentation Methods Based on Machine Learning for Intracoronary Optical Coherence Tomography Image\",\"authors\":\"Caining Zhang, Xiaoya Guo, D. Tang, D. Molony, Chun Yang, H. Samady, Jie Zheng, G. Mintz, A. Maehara, M. Matsumura, D. Giddens\",\"doi\":\"10.32604/MCB.2019.05747\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Cardiovascular diseases are closely associated with sudden rupture of atherosclerotic plaques. Previous image modalities such as magnetic resonance imaging (MRI) and intravascular ultrasound (IVUS) were unable to identify vulnerable plaques due to their limited resolution. Optical coherence tomography (OCT) is an advanced intravascular imaging technique developed in recent years which has high resolution approximately 10 microns and could provide more accurate morphology of coronary plaque. In particular, it is now possible to identify plaques with fibrous cap thickness < 65 µm, an accepted threshold value for vulnerable plaques. However, the current segmentation of OCT images are still performed manually by physicians and the process is time consuming. Automatic segmentation and recognition of vulnerable plaques through quantification of plaque components have great clinical significance for cardiovascular research. Two segmentation methods for intracoronary OCT image based on support vector machine (SVM) and convolutional neural network (CNN) were performed to detect the lumen borders and characterize the plaque component. \\nIn vivo IVUS and OCT coronary plaque data from 5 patients were acquired at Emory University with patient’s consent obtained. Seventy-seven matched IVUS and OCT slices with good image quality and medium to large lipid cores were selected for our segmentation study. Manual OCT segmentation was performed by experts and used as gold standard in the automatic segmentations. VH-IVUS was used as references and guide by the experts in the manual segmentation process. Three plaque component tissue classes were identified from OCT images in this work: lipid tissue (LT), fibrous tissue (FT) and background (BG). Procedures using two machine learning methods (CNN and SVM) were developed to segment OCT images, respectively. For CNN method, the U-Net architecture was selected due to its good performance in very different biomedical segmentation and very few annotated images. For SVM method, local binary patterns (LBPs), gray level co-occurrence matrices (GLCMs) which contains contrast, correlation, energy and homogeneity, entropy and mean value were calculated as features and assembled to feed SVM classifier. The accuracies of two segmentation methods were evaluated and compared using the OCT dataset. Segmentation accuracy is defined as the ratio of the number of pixels correctly classified over the total number of pixels. \\nThe overall classification accuracy based CNN method reached 95.8%, and the accuracies for LT, FT and BG were 86.8%, 83.4%, and 98.2%, respectively. The overall classification accuracy based SVM was 71.9%, and per-class accuracy for LT, FT and BG was 75.4%, 78.3%, and 67.0%, respectively. \\nThe two methods proposed can automatically detect the lumen borders and characterize the composition of the superficial plaque in OCT images and greatly reduce the time spent by doctors in segmenting and identifying plaques. CNN provided better segmentation accuracies compared to those achieved by SVM. \\nAcknowledgement: This research was supported in part by NIH grant R01 EB004759, National Sciences Foundation of China grant 11672001 and a Jiangsu Province Science and Technology Agency grant BE2016785.\",\"PeriodicalId\":48719,\"journal\":{\"name\":\"Molecular & Cellular Biomechanics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-02-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Molecular & Cellular Biomechanics\",\"FirstCategoryId\":\"1087\",\"ListUrlMain\":\"https://doi.org/10.32604/MCB.2019.05747\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Biochemistry, Genetics and Molecular Biology\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Molecular & Cellular Biomechanics","FirstCategoryId":"1087","ListUrlMain":"https://doi.org/10.32604/MCB.2019.05747","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Biochemistry, Genetics and Molecular Biology","Score":null,"Total":0}
Automatic Segmentation Methods Based on Machine Learning for Intracoronary Optical Coherence Tomography Image
Cardiovascular diseases are closely associated with sudden rupture of atherosclerotic plaques. Previous image modalities such as magnetic resonance imaging (MRI) and intravascular ultrasound (IVUS) were unable to identify vulnerable plaques due to their limited resolution. Optical coherence tomography (OCT) is an advanced intravascular imaging technique developed in recent years which has high resolution approximately 10 microns and could provide more accurate morphology of coronary plaque. In particular, it is now possible to identify plaques with fibrous cap thickness < 65 µm, an accepted threshold value for vulnerable plaques. However, the current segmentation of OCT images are still performed manually by physicians and the process is time consuming. Automatic segmentation and recognition of vulnerable plaques through quantification of plaque components have great clinical significance for cardiovascular research. Two segmentation methods for intracoronary OCT image based on support vector machine (SVM) and convolutional neural network (CNN) were performed to detect the lumen borders and characterize the plaque component.
In vivo IVUS and OCT coronary plaque data from 5 patients were acquired at Emory University with patient’s consent obtained. Seventy-seven matched IVUS and OCT slices with good image quality and medium to large lipid cores were selected for our segmentation study. Manual OCT segmentation was performed by experts and used as gold standard in the automatic segmentations. VH-IVUS was used as references and guide by the experts in the manual segmentation process. Three plaque component tissue classes were identified from OCT images in this work: lipid tissue (LT), fibrous tissue (FT) and background (BG). Procedures using two machine learning methods (CNN and SVM) were developed to segment OCT images, respectively. For CNN method, the U-Net architecture was selected due to its good performance in very different biomedical segmentation and very few annotated images. For SVM method, local binary patterns (LBPs), gray level co-occurrence matrices (GLCMs) which contains contrast, correlation, energy and homogeneity, entropy and mean value were calculated as features and assembled to feed SVM classifier. The accuracies of two segmentation methods were evaluated and compared using the OCT dataset. Segmentation accuracy is defined as the ratio of the number of pixels correctly classified over the total number of pixels.
The overall classification accuracy based CNN method reached 95.8%, and the accuracies for LT, FT and BG were 86.8%, 83.4%, and 98.2%, respectively. The overall classification accuracy based SVM was 71.9%, and per-class accuracy for LT, FT and BG was 75.4%, 78.3%, and 67.0%, respectively.
The two methods proposed can automatically detect the lumen borders and characterize the composition of the superficial plaque in OCT images and greatly reduce the time spent by doctors in segmenting and identifying plaques. CNN provided better segmentation accuracies compared to those achieved by SVM.
Acknowledgement: This research was supported in part by NIH grant R01 EB004759, National Sciences Foundation of China grant 11672001 and a Jiangsu Province Science and Technology Agency grant BE2016785.
期刊介绍:
The field of biomechanics concerns with motion, deformation, and forces in biological systems. With the explosive progress in molecular biology, genomic engineering, bioimaging, and nanotechnology, there will be an ever-increasing generation of knowledge and information concerning the mechanobiology of genes, proteins, cells, tissues, and organs. Such information will bring new diagnostic tools, new therapeutic approaches, and new knowledge on ourselves and our interactions with our environment. It becomes apparent that biomechanics focusing on molecules, cells as well as tissues and organs is an important aspect of modern biomedical sciences. The aims of this journal are to facilitate the studies of the mechanics of biomolecules (including proteins, genes, cytoskeletons, etc.), cells (and their interactions with extracellular matrix), tissues and organs, the development of relevant advanced mathematical methods, and the discovery of biological secrets. As science concerns only with relative truth, we seek ideas that are state-of-the-art, which may be controversial, but stimulate and promote new ideas, new techniques, and new applications.