用于产前超声图像分析中胎儿头-耻骨联合分割的 "任何分割 "模型

IF 7.5 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Zihao Zhou , Yaosheng Lu , Jieyun Bai , Víctor M. Campello , Fan Feng , Karim Lekadir
{"title":"用于产前超声图像分析中胎儿头-耻骨联合分割的 \"任何分割 \"模型","authors":"Zihao Zhou ,&nbsp;Yaosheng Lu ,&nbsp;Jieyun Bai ,&nbsp;Víctor M. Campello ,&nbsp;Fan Feng ,&nbsp;Karim Lekadir","doi":"10.1016/j.eswa.2024.125699","DOIUrl":null,"url":null,"abstract":"<div><div>The Angle of Progression (AoP), determined by the contour delineations of the pubic symphysis and fetal head (PSFH) in intrapartum ultrasound (US) images, is crucial for predicting delivery mode and significantly influences labor outcomes. However, automating AoP measurement based on PSFH segmentation remains challenging due to poor foreground-background contrast, blurred boundaries, and anatomical variability in shapes, sizes, and positions during labor. We propose a novel Segment Anything Model (SAM) framework, AoP-SAM, designed to enhance the PSFH segmentation, AoP measurement and outcome prediction, tackling the challenges of small target segmentation and accurate boundary segmentation. It synergistically combines CNNs and Transformers within a cooperative encoder to process complex spatial relationships and contextual information to segment the PSFH. In this encoder, we devise a multi-scale CNN branch to capture intrinsic local details, which compensates for the defects of the Transformer branch in extracting local features. Further, a cross-branch attention module is applied to improve prediction by fostering the effective information exchange and integration between two branches. Evaluations on the benchmark dataset demonstrate that our method achieves state-of-the-art (SOTA) performance. Specifically, in the PSFH segmentation task, the AoP measurement task, and the AoP classification task, we achieved a DSC of 0.8745 on the PS structure, a <span><math><mi>Δ</mi></math></span>AoP of 7.6743°, and an F1-score of 0.7719, respectively. Compared to the second-ranking method, these results represent improvements of 2.5%, 6.3%, and 1.1%. Our study presents a framework for intrapartum biometry, offering significant advancements in labor monitoring and delivery mode prediction in clinical settings. Future efforts will focus on optimizing AoP-SAM for resource-constrained environments, highlighting its potential for lightweight adaptation. <span><span>https://github.com/maskoffs/AoP-SAM</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"263 ","pages":"Article 125699"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Segment Anything Model for fetal head-pubic symphysis segmentation in intrapartum ultrasound image analysis\",\"authors\":\"Zihao Zhou ,&nbsp;Yaosheng Lu ,&nbsp;Jieyun Bai ,&nbsp;Víctor M. Campello ,&nbsp;Fan Feng ,&nbsp;Karim Lekadir\",\"doi\":\"10.1016/j.eswa.2024.125699\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The Angle of Progression (AoP), determined by the contour delineations of the pubic symphysis and fetal head (PSFH) in intrapartum ultrasound (US) images, is crucial for predicting delivery mode and significantly influences labor outcomes. However, automating AoP measurement based on PSFH segmentation remains challenging due to poor foreground-background contrast, blurred boundaries, and anatomical variability in shapes, sizes, and positions during labor. We propose a novel Segment Anything Model (SAM) framework, AoP-SAM, designed to enhance the PSFH segmentation, AoP measurement and outcome prediction, tackling the challenges of small target segmentation and accurate boundary segmentation. It synergistically combines CNNs and Transformers within a cooperative encoder to process complex spatial relationships and contextual information to segment the PSFH. In this encoder, we devise a multi-scale CNN branch to capture intrinsic local details, which compensates for the defects of the Transformer branch in extracting local features. Further, a cross-branch attention module is applied to improve prediction by fostering the effective information exchange and integration between two branches. Evaluations on the benchmark dataset demonstrate that our method achieves state-of-the-art (SOTA) performance. Specifically, in the PSFH segmentation task, the AoP measurement task, and the AoP classification task, we achieved a DSC of 0.8745 on the PS structure, a <span><math><mi>Δ</mi></math></span>AoP of 7.6743°, and an F1-score of 0.7719, respectively. Compared to the second-ranking method, these results represent improvements of 2.5%, 6.3%, and 1.1%. Our study presents a framework for intrapartum biometry, offering significant advancements in labor monitoring and delivery mode prediction in clinical settings. Future efforts will focus on optimizing AoP-SAM for resource-constrained environments, highlighting its potential for lightweight adaptation. <span><span>https://github.com/maskoffs/AoP-SAM</span><svg><path></path></svg></span>.</div></div>\",\"PeriodicalId\":50461,\"journal\":{\"name\":\"Expert Systems with Applications\",\"volume\":\"263 \",\"pages\":\"Article 125699\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2024-11-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Expert Systems with Applications\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0957417424025661\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417424025661","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

耻骨联合和胎头(PSFH)在产前超声(US)图像中的轮廓划分决定了产程进展角(AoP),它对预测分娩方式至关重要,并对分娩结果有重大影响。然而,由于前景-背景对比度差、边界模糊以及分娩过程中形状、大小和位置的解剖变异,基于 PSFH 分割的 AoP 自动测量仍具有挑战性。我们提出了一种新颖的 "任意分割模型"(Segment Anything Model,SAM)框架,即 AoP-SAM,旨在增强 PSFH 分割、AoP 测量和结果预测,解决小目标分割和精确边界分割的难题。它将 CNN 和变换器协同结合到一个合作编码器中,以处理复杂的空间关系和上下文信息,从而分割 PSFH。在该编码器中,我们设计了一个多尺度 CNN 分支来捕捉固有的局部细节,从而弥补了 Transformer 分支在提取局部特征方面的缺陷。此外,我们还应用了跨分支关注模块,通过促进两个分支之间的有效信息交换和整合来改进预测。在基准数据集上进行的评估表明,我们的方法达到了最先进(SOTA)的性能。具体来说,在 PSFH 分割任务、AoP 测量任务和 AoP 分类任务中,我们在 PS 结构上分别取得了 0.8745 的 DSC 值、7.6743° 的 ΔAoP 值和 0.7719 的 F1 分数。与二级排序法相比,这些结果分别提高了 2.5%、6.3% 和 1.1%。我们的研究提出了产中生物测量的框架,为临床环境中的产程监测和分娩方式预测提供了重大进展。未来的工作重点是针对资源有限的环境优化 AoP-SAM,突出其轻量级适应的潜力。https://github.com/maskoffs/AoP-SAM。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Segment Anything Model for fetal head-pubic symphysis segmentation in intrapartum ultrasound image analysis

Segment Anything Model for fetal head-pubic symphysis segmentation in intrapartum ultrasound image analysis
The Angle of Progression (AoP), determined by the contour delineations of the pubic symphysis and fetal head (PSFH) in intrapartum ultrasound (US) images, is crucial for predicting delivery mode and significantly influences labor outcomes. However, automating AoP measurement based on PSFH segmentation remains challenging due to poor foreground-background contrast, blurred boundaries, and anatomical variability in shapes, sizes, and positions during labor. We propose a novel Segment Anything Model (SAM) framework, AoP-SAM, designed to enhance the PSFH segmentation, AoP measurement and outcome prediction, tackling the challenges of small target segmentation and accurate boundary segmentation. It synergistically combines CNNs and Transformers within a cooperative encoder to process complex spatial relationships and contextual information to segment the PSFH. In this encoder, we devise a multi-scale CNN branch to capture intrinsic local details, which compensates for the defects of the Transformer branch in extracting local features. Further, a cross-branch attention module is applied to improve prediction by fostering the effective information exchange and integration between two branches. Evaluations on the benchmark dataset demonstrate that our method achieves state-of-the-art (SOTA) performance. Specifically, in the PSFH segmentation task, the AoP measurement task, and the AoP classification task, we achieved a DSC of 0.8745 on the PS structure, a ΔAoP of 7.6743°, and an F1-score of 0.7719, respectively. Compared to the second-ranking method, these results represent improvements of 2.5%, 6.3%, and 1.1%. Our study presents a framework for intrapartum biometry, offering significant advancements in labor monitoring and delivery mode prediction in clinical settings. Future efforts will focus on optimizing AoP-SAM for resource-constrained environments, highlighting its potential for lightweight adaptation. https://github.com/maskoffs/AoP-SAM.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Expert Systems with Applications
Expert Systems with Applications 工程技术-工程:电子与电气
CiteScore
13.80
自引率
10.60%
发文量
2045
审稿时长
8.7 months
期刊介绍: Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信