Beyond pixel: Superpixel-based MRI segmentation through traditional machine learning and graph convolutional network

IF 4.9 2区 医学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Zakia Khatun , Halldór Jónsson Jr. , Mariella Tsirilaki , Nicola Maffulli , Francesco Oliva , Pauline Daval , Francesco Tortorella , Paolo Gargiulo
{"title":"Beyond pixel: Superpixel-based MRI segmentation through traditional machine learning and graph convolutional network","authors":"Zakia Khatun ,&nbsp;Halldór Jónsson Jr. ,&nbsp;Mariella Tsirilaki ,&nbsp;Nicola Maffulli ,&nbsp;Francesco Oliva ,&nbsp;Pauline Daval ,&nbsp;Francesco Tortorella ,&nbsp;Paolo Gargiulo","doi":"10.1016/j.cmpb.2024.108398","DOIUrl":null,"url":null,"abstract":"<div><h3>Background and Objective:</h3><p>Tendon segmentation is crucial for studying tendon-related pathologies like tendinopathy, tendinosis, etc. This step further enables detailed analysis of specific tendon regions using automated or semi-automated methods. This study specifically aims at the segmentation of Achilles tendon, the largest tendon in the human body.</p></div><div><h3>Methods:</h3><p>This study proposes a comprehensive end-to-end tendon segmentation module composed of a preliminary superpixel-based coarse segmentation preceding the final segmentation task. The final segmentation results are obtained through two distinct approaches. In the first approach, the coarsely generated superpixels are subjected to classification using Random Forest (RF) and Support Vector Machine (SVM) classifiers to classify whether each superpixel belongs to a tendon class or not (resulting in tendon segmentation). In the second approach, the arrangements of superpixels are converted to graphs instead of being treated as conventional image grids. This classification process uses a graph-based convolutional network (GCN) to determine whether each superpixel corresponds to a tendon class or not.</p></div><div><h3>Results:</h3><p>All experiments are conducted on a custom-made ankle MRI dataset. The dataset comprises 76 subjects and is divided into two sets: one for training (Dataset 1, trained and evaluated using leave-one-group-out cross-validation) and the other as unseen test data (Dataset 2). Using our first approach, the final test AUC (Area Under the ROC Curve) scores using RF and SVM classifiers on the test data (Dataset 2) are 0.992 and 0.987, respectively, with sensitivities of 0.904 and 0.966. On the other hand, using our second approach (GCN-based node classification), the AUC score for the test set is 0.933 with a sensitivity of 0.899.</p></div><div><h3>Conclusions:</h3><p>Our proposed pipeline demonstrates the efficacy of employing superpixel generation as a coarse segmentation technique for the final tendon segmentation. Whether utilizing RF, SVM-based superpixel classification, or GCN-based classification for tendon segmentation, our system consistently achieves commendable AUC scores, especially the non-graph-based approach. Given the limited dataset, our graph-based method did not perform as well as non-graph-based superpixel classifications; however, the results obtained provide valuable insights into how well the models can distinguish between tendons and non-tendons. This opens up opportunities for further exploration and improvement.</p></div>","PeriodicalId":10624,"journal":{"name":"Computer methods and programs in biomedicine","volume":"256 ","pages":"Article 108398"},"PeriodicalIF":4.9000,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0169260724003912/pdfft?md5=ec546df96619be9e2501c6602cc6ef74&pid=1-s2.0-S0169260724003912-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer methods and programs in biomedicine","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0169260724003912","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

Background and Objective:

Tendon segmentation is crucial for studying tendon-related pathologies like tendinopathy, tendinosis, etc. This step further enables detailed analysis of specific tendon regions using automated or semi-automated methods. This study specifically aims at the segmentation of Achilles tendon, the largest tendon in the human body.

Methods:

This study proposes a comprehensive end-to-end tendon segmentation module composed of a preliminary superpixel-based coarse segmentation preceding the final segmentation task. The final segmentation results are obtained through two distinct approaches. In the first approach, the coarsely generated superpixels are subjected to classification using Random Forest (RF) and Support Vector Machine (SVM) classifiers to classify whether each superpixel belongs to a tendon class or not (resulting in tendon segmentation). In the second approach, the arrangements of superpixels are converted to graphs instead of being treated as conventional image grids. This classification process uses a graph-based convolutional network (GCN) to determine whether each superpixel corresponds to a tendon class or not.

Results:

All experiments are conducted on a custom-made ankle MRI dataset. The dataset comprises 76 subjects and is divided into two sets: one for training (Dataset 1, trained and evaluated using leave-one-group-out cross-validation) and the other as unseen test data (Dataset 2). Using our first approach, the final test AUC (Area Under the ROC Curve) scores using RF and SVM classifiers on the test data (Dataset 2) are 0.992 and 0.987, respectively, with sensitivities of 0.904 and 0.966. On the other hand, using our second approach (GCN-based node classification), the AUC score for the test set is 0.933 with a sensitivity of 0.899.

Conclusions:

Our proposed pipeline demonstrates the efficacy of employing superpixel generation as a coarse segmentation technique for the final tendon segmentation. Whether utilizing RF, SVM-based superpixel classification, or GCN-based classification for tendon segmentation, our system consistently achieves commendable AUC scores, especially the non-graph-based approach. Given the limited dataset, our graph-based method did not perform as well as non-graph-based superpixel classifications; however, the results obtained provide valuable insights into how well the models can distinguish between tendons and non-tendons. This opens up opportunities for further exploration and improvement.

超越像素:通过传统机器学习和图卷积网络进行基于超像素的磁共振成像分割
背景和目的:肌腱分割对于研究肌腱相关病症(如肌腱病、肌腱变性等)至关重要。通过这一步骤,可以使用自动化或半自动化方法进一步对特定肌腱区域进行详细分析。方法:本研究提出了一个全面的端到端肌腱分割模块,由基于超像素的初步粗分割和最终分割任务组成。最终的分割结果通过两种不同的方法获得。在第一种方法中,使用随机森林(RF)和支持向量机(SVM)分类器对粗略生成的超像素进行分类,以确定每个超像素是否属于肌腱类别(从而进行肌腱分割)。在第二种方法中,超像素的排列被转换成图,而不是传统的图像网格。这一分类过程使用基于图的卷积网络(GCN)来确定每个超像素是否对应于肌腱类别。数据集由 76 名受试者组成,分为两组:一组用于训练(数据集 1,采用 "留一弃组 "交叉验证法进行训练和评估),另一组作为未见测试数据(数据集 2)。使用我们的第一种方法,RF 和 SVM 分类器在测试数据(数据集 2)上的最终测试 AUC(ROC 曲线下面积)得分分别为 0.992 和 0.987,灵敏度分别为 0.904 和 0.966。另一方面,使用我们的第二种方法(基于 GCN 的节点分类),测试集的 AUC 得分为 0.933,灵敏度为 0.899。无论是利用射频、基于 SVM 的超像素分类,还是基于 GCN 的分类进行肌腱分割,我们的系统都能获得值得称赞的 AUC 分数,尤其是非基于图谱的方法。由于数据集有限,我们基于图的方法的表现不如非基于图的超像素分类方法;但是,所获得的结果为我们了解模型如何区分肌腱和非肌腱提供了宝贵的见解。这为进一步探索和改进提供了机会。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer methods and programs in biomedicine
Computer methods and programs in biomedicine 工程技术-工程:生物医学
CiteScore
12.30
自引率
6.60%
发文量
601
审稿时长
135 days
期刊介绍: To encourage the development of formal computing methods, and their application in biomedical research and medical practice, by illustration of fundamental principles in biomedical informatics research; to stimulate basic research into application software design; to report the state of research of biomedical information processing projects; to report new computer methodologies applied in biomedical areas; the eventual distribution of demonstrable software to avoid duplication of effort; to provide a forum for discussion and improvement of existing software; to optimize contact between national organizations and regional user groups by promoting an international exchange of information on formal methods, standards and software in biomedicine. Computer Methods and Programs in Biomedicine covers computing methodology and software systems derived from computing science for implementation in all aspects of biomedical research and medical practice. It is designed to serve: biochemists; biologists; geneticists; immunologists; neuroscientists; pharmacologists; toxicologists; clinicians; epidemiologists; psychiatrists; psychologists; cardiologists; chemists; (radio)physicists; computer scientists; programmers and systems analysts; biomedical, clinical, electrical and other engineers; teachers of medical informatics and users of educational software.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信