一个多特征融合模型测量胎儿在分娩过程中的头部屈曲变形和变形多头自注意

IF 5.4 2区 医学 Q1 ENGINEERING, BIOMEDICAL
Shijie Zhang , Shaozheng He , Jingjing Wu , Dandan Wang , Pan Zeng , Guorong Lyu
{"title":"一个多特征融合模型测量胎儿在分娩过程中的头部屈曲变形和变形多头自注意","authors":"Shijie Zhang ,&nbsp;Shaozheng He ,&nbsp;Jingjing Wu ,&nbsp;Dandan Wang ,&nbsp;Pan Zeng ,&nbsp;Guorong Lyu","doi":"10.1016/j.compmedimag.2025.102582","DOIUrl":null,"url":null,"abstract":"<div><div>Fetal head flexion is essential during labor. The current assessment presents technical challenges for unskilled ultrasound operators. Therefore, the study aimed to propose an occiput-spine angle measurement network (OSAM-NET) to improve the accuracy and intrapartum applicability of fetal head flexion assessment. We used YOLOv8 to extract key anatomical structures (occiput and spine) and Vision Transformer to extract global features on ultrasound images of the posterior mid-sagittal section of the fetus (PMSF). Then, by fusing the geometric location information and global features through the multi-head self-attention mechanism, we constructed the multi-feature fusion model OSAM-NET. The model was able to extract intricate features from multi-dimensional information, effectively boosting the accuracy of occiput-spine angle (OSA) prediction. We curated the first OSA dataset comprising 1688 high-quality, clear PMSF ultrasound images and annotations to train and test our model. We evaluated the performance of OSAM-NET and compared it with other models. The results showed that OSAM-NET outperformed the comparison models on all evaluation metrics, with R² increasing by nearly 13 %, and root mean square error (RMSE) and mean absolute error (MAE) decreasing by approximately 15 % and 20 %, respectively. The intraclass correlation coefficient (ICC) improved by about 8 %, with the average value reaching 0.89, indicating good agreement with the measurements of ultrasound experts. The multi-feature fusion model OSAM-NET demonstrates strong applicability and predictive accuracy for complex ultrasound images. This study provides a reliable and efficient tool for automatically evaluating fetal head flexion. The real-world application potential has been validated on prospective test dataset.</div></div>","PeriodicalId":50631,"journal":{"name":"Computerized Medical Imaging and Graphics","volume":"124 ","pages":"Article 102582"},"PeriodicalIF":5.4000,"publicationDate":"2025-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"OSAM-NET: A multi-feature fusion model for measuring fetal head flexion during labor with transformer multi-head self-attention\",\"authors\":\"Shijie Zhang ,&nbsp;Shaozheng He ,&nbsp;Jingjing Wu ,&nbsp;Dandan Wang ,&nbsp;Pan Zeng ,&nbsp;Guorong Lyu\",\"doi\":\"10.1016/j.compmedimag.2025.102582\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Fetal head flexion is essential during labor. The current assessment presents technical challenges for unskilled ultrasound operators. Therefore, the study aimed to propose an occiput-spine angle measurement network (OSAM-NET) to improve the accuracy and intrapartum applicability of fetal head flexion assessment. We used YOLOv8 to extract key anatomical structures (occiput and spine) and Vision Transformer to extract global features on ultrasound images of the posterior mid-sagittal section of the fetus (PMSF). Then, by fusing the geometric location information and global features through the multi-head self-attention mechanism, we constructed the multi-feature fusion model OSAM-NET. The model was able to extract intricate features from multi-dimensional information, effectively boosting the accuracy of occiput-spine angle (OSA) prediction. We curated the first OSA dataset comprising 1688 high-quality, clear PMSF ultrasound images and annotations to train and test our model. We evaluated the performance of OSAM-NET and compared it with other models. The results showed that OSAM-NET outperformed the comparison models on all evaluation metrics, with R² increasing by nearly 13 %, and root mean square error (RMSE) and mean absolute error (MAE) decreasing by approximately 15 % and 20 %, respectively. The intraclass correlation coefficient (ICC) improved by about 8 %, with the average value reaching 0.89, indicating good agreement with the measurements of ultrasound experts. The multi-feature fusion model OSAM-NET demonstrates strong applicability and predictive accuracy for complex ultrasound images. This study provides a reliable and efficient tool for automatically evaluating fetal head flexion. The real-world application potential has been validated on prospective test dataset.</div></div>\",\"PeriodicalId\":50631,\"journal\":{\"name\":\"Computerized Medical Imaging and Graphics\",\"volume\":\"124 \",\"pages\":\"Article 102582\"},\"PeriodicalIF\":5.4000,\"publicationDate\":\"2025-05-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computerized Medical Imaging and Graphics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0895611125000916\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computerized Medical Imaging and Graphics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0895611125000916","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0

摘要

胎儿头部弯曲在分娩过程中是必不可少的。目前的评估对不熟练的超声操作员提出了技术挑战。因此,本研究旨在提出枕骨-脊柱角度测量网络(OSAM-NET),以提高胎儿头部屈曲评估的准确性和产时适用性。我们使用YOLOv8提取关键解剖结构(枕部和脊柱),使用Vision Transformer提取胎儿后正中矢状面(PMSF)超声图像的全局特征。然后,通过多头自关注机制融合几何位置信息和全局特征,构建多特征融合模型OSAM-NET。该模型能够从多维信息中提取复杂特征,有效提高枕脊角(OSA)预测的准确性。我们策划了第一个OSA数据集,包括1688个高质量,清晰的PMSF超声图像和注释,以训练和测试我们的模型。我们评估了OSAM-NET的性能,并将其与其他模型进行了比较。结果表明,OSAM-NET在所有评价指标上都优于比较模型,R²增加了近13 %,均方根误差(RMSE)和平均绝对误差(MAE)分别减少了约15 %和20 %。类内相关系数(ICC)提高了约8 %,平均值达到0.89,与超声专家测量结果吻合较好。多特征融合模型OSAM-NET对复杂超声图像具有很强的适用性和预测精度。本研究为胎儿头部屈曲的自动评估提供了可靠、有效的工具。实际应用潜力已在前瞻性测试数据集上得到验证。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
OSAM-NET: A multi-feature fusion model for measuring fetal head flexion during labor with transformer multi-head self-attention
Fetal head flexion is essential during labor. The current assessment presents technical challenges for unskilled ultrasound operators. Therefore, the study aimed to propose an occiput-spine angle measurement network (OSAM-NET) to improve the accuracy and intrapartum applicability of fetal head flexion assessment. We used YOLOv8 to extract key anatomical structures (occiput and spine) and Vision Transformer to extract global features on ultrasound images of the posterior mid-sagittal section of the fetus (PMSF). Then, by fusing the geometric location information and global features through the multi-head self-attention mechanism, we constructed the multi-feature fusion model OSAM-NET. The model was able to extract intricate features from multi-dimensional information, effectively boosting the accuracy of occiput-spine angle (OSA) prediction. We curated the first OSA dataset comprising 1688 high-quality, clear PMSF ultrasound images and annotations to train and test our model. We evaluated the performance of OSAM-NET and compared it with other models. The results showed that OSAM-NET outperformed the comparison models on all evaluation metrics, with R² increasing by nearly 13 %, and root mean square error (RMSE) and mean absolute error (MAE) decreasing by approximately 15 % and 20 %, respectively. The intraclass correlation coefficient (ICC) improved by about 8 %, with the average value reaching 0.89, indicating good agreement with the measurements of ultrasound experts. The multi-feature fusion model OSAM-NET demonstrates strong applicability and predictive accuracy for complex ultrasound images. This study provides a reliable and efficient tool for automatically evaluating fetal head flexion. The real-world application potential has been validated on prospective test dataset.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
10.70
自引率
3.50%
发文量
71
审稿时长
26 days
期刊介绍: The purpose of the journal Computerized Medical Imaging and Graphics is to act as a source for the exchange of research results concerning algorithmic advances, development, and application of digital imaging in disease detection, diagnosis, intervention, prevention, precision medicine, and population health. Included in the journal will be articles on novel computerized imaging or visualization techniques, including artificial intelligence and machine learning, augmented reality for surgical planning and guidance, big biomedical data visualization, computer-aided diagnosis, computerized-robotic surgery, image-guided therapy, imaging scanning and reconstruction, mobile and tele-imaging, radiomics, and imaging integration and modeling with other information relevant to digital health. The types of biomedical imaging include: magnetic resonance, computed tomography, ultrasound, nuclear medicine, X-ray, microwave, optical and multi-photon microscopy, video and sensory imaging, and the convergence of biomedical images with other non-imaging datasets.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信