Slice-based YOLO-SAM hybrid prompting framework for automatic medical image segmentation.

IF 2.8 3区 综合性期刊 Q1 MULTIDISCIPLINARY SCIENCES
PLoS ONE Pub Date : 2026-11-13 eCollection Date: 2026-01-01 DOI:10.1371/journal.pone.0360939
Xiaobo Liu, Qiuyan Pei, Xiaoyu Wang, Honghang Luo
{"title":"Slice-based YOLO-SAM hybrid prompting framework for automatic medical image segmentation.","authors":"Xiaobo Liu, Qiuyan Pei, Xiaoyu Wang, Honghang Luo","doi":"10.1371/journal.pone.0360939","DOIUrl":null,"url":null,"abstract":"<p><p>Accurate medical image segmentation is essential for computer-aided diagnosis, treatment planning, and quantitative image analysis. This study evaluates a slice-based automatic segmentation framework that couples YOLOv8-based region localization with prompt-driven Segment Anything Model (SAM) segmentation. In contrast to a simple YOLOv8 + SAM cascade using only bounding-box prompts, the proposed framework adds hybrid prompt generation with bounding boxes and positive/negative points, parameter-efficient fine-tuning of the SAM prompt encoder and mask decoder, and lightweight post-processing. The framework is evaluated on two public datasets under explicitly defined local protocols: 2D slice-based prostate MRI segmentation using Prostate158 and skin lesion segmentation using an internal ISIC 2018 split. On Prostate158, the method obtains Dice coefficients of 89.2%, 76.8%, and 65.3% for central gland, peripheral zone, and prostate cancer lesion segmentation, respectively. On the local ISIC 2018 split, it obtains a Dice coefficient of 94.8% and a Jaccard index of 91.5%. These results indicate competitive performance under the implemented experimental protocol, but they should not be interpreted as protocol-independent state-of-the-art claims. The manuscript clarifies the evaluation unit, prompt-source protocol, 2D processing strategy, hyperparameter settings, baseline grouping, and limitations related to statistical uncertainty, detector failure propagation, and clinical translation.</p>","PeriodicalId":20189,"journal":{"name":"PLoS ONE","volume":"21 11","pages":"e0360939"},"PeriodicalIF":2.8000,"publicationDate":"2026-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13766228/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"PLoS ONE","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1371/journal.pone.0360939","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Accurate medical image segmentation is essential for computer-aided diagnosis, treatment planning, and quantitative image analysis. This study evaluates a slice-based automatic segmentation framework that couples YOLOv8-based region localization with prompt-driven Segment Anything Model (SAM) segmentation. In contrast to a simple YOLOv8 + SAM cascade using only bounding-box prompts, the proposed framework adds hybrid prompt generation with bounding boxes and positive/negative points, parameter-efficient fine-tuning of the SAM prompt encoder and mask decoder, and lightweight post-processing. The framework is evaluated on two public datasets under explicitly defined local protocols: 2D slice-based prostate MRI segmentation using Prostate158 and skin lesion segmentation using an internal ISIC 2018 split. On Prostate158, the method obtains Dice coefficients of 89.2%, 76.8%, and 65.3% for central gland, peripheral zone, and prostate cancer lesion segmentation, respectively. On the local ISIC 2018 split, it obtains a Dice coefficient of 94.8% and a Jaccard index of 91.5%. These results indicate competitive performance under the implemented experimental protocol, but they should not be interpreted as protocol-independent state-of-the-art claims. The manuscript clarifies the evaluation unit, prompt-source protocol, 2D processing strategy, hyperparameter settings, baseline grouping, and limitations related to statistical uncertainty, detector failure propagation, and clinical translation.

基于切片的医学图像自动分割YOLO-SAM混合提示框架。
准确的医学图像分割对于计算机辅助诊断、治疗计划和定量图像分析至关重要。本研究评估了基于yolov8的区域定位与提示驱动的SAM (Segment Anything Model)分割相结合的基于切片的自动分割框架。与仅使用边界框提示的简单YOLOv8 + SAM级联相比,所提出的框架增加了带有边界框和正/负点的混合提示生成,SAM提示编码器和掩码解码器的参数高效微调以及轻量级后处理。在明确定义的局部协议下,该框架在两个公共数据集上进行了评估:使用prostat158进行基于二维切片的前列腺MRI分割,使用内部ISIC 2018分割进行皮肤病变分割。在prostat158上,该方法对中央腺、外周带和前列腺癌病变分割的Dice系数分别为89.2%、76.8%和65.3%。在本地ISIC 2018分割上,得到Dice系数94.8%,Jaccard指数91.5%。这些结果表明在实施的实验协议下的竞争表现,但它们不应被解释为独立于协议的最新技术主张。本文阐明了评估单元、提示源协议、二维处理策略、超参数设置、基线分组,以及与统计不确定性、检测器故障传播和临床翻译相关的限制。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
PLoS ONE
PLoS ONE 生物-生物学
CiteScore
6.20
自引率
5.40%
发文量
14242
审稿时长
3.7 months
期刊介绍: PLOS ONE is an international, peer-reviewed, open-access, online publication. PLOS ONE welcomes reports on primary research from any scientific discipline. It provides: * Open-access—freely accessible online, authors retain copyright * Fast publication times * Peer review by expert, practicing researchers * Post-publication tools to indicate quality and impact * Community-based dialogue on articles * Worldwide media coverage
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书