Sang Kyun Yoo, Tae Hyung Kim, Jin Sung Kim, Sung Soo Ahn, Eui Hyun Kim, Wonmo Sung, Hojin Kim, Hong In Yoon
{"title":"Enhancing Brain Metastases Detection and Segmentation in Black-Blood MRI Using Deep Learning and Segment Anything Model (SAM).","authors":"Sang Kyun Yoo, Tae Hyung Kim, Jin Sung Kim, Sung Soo Ahn, Eui Hyun Kim, Wonmo Sung, Hojin Kim, Hong In Yoon","doi":"10.3349/ymj.2024.0198","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Black-blood (BB) magnetic resonance images (MRI) offer superior image contrast for the detection and segmentation of brain metastases (BMs). This study investigated the efficacy and accuracy of deep learning (DL) architectures and post-processing for BMs detection and segmentation with BB images.</p><p><strong>Materials and methods: </strong>The BB images of 50 patients were collect to train (40) and test (10) the DL model. To ensure consistency, we implemented piecewise linear histogram matching for intensity normalization and resampling. Modified U-Net, including combination with generative adversarial network (GAN), was applied to enhance the segmentation performance. The U-Net-based networks generated bounding boxes indicating regions of interest, which were then processed in a post-processing using the Segment Anything Model (SAM). We quantitatively assessed the three U-Net-based models and their post-processed counterparts in terms of lesion-wise sensitivity (LWS), patient-wise dice similarity coefficient (DSC), and average false-positive rate (FPR).</p><p><strong>Results: </strong>The modified U-Net with GAN yielded a patient-wise DSC of 0.853 and a LWS of 89.19%, which outperformed the standard U-Net (patient-wise DSC of 0.815) and modified U-Net only (patient-wise DSC of 0.846). Combining GAN architecture with modified U-Net also reduced the FPR, less than 1 on average. Post-processing with SAM further did not affect LWS and FPR, but effectively enhanced the patient-wise DSC by 2%-3% for the U-Net-based models.</p><p><strong>Conclusion: </strong>The modifications to standard U-Net notably improves the detection and segmentation of BMs in BB images, and applying SAM as post-processing can further enhance the precision of segmentation results.</p>","PeriodicalId":23765,"journal":{"name":"Yonsei Medical Journal","volume":"66 8","pages":"502-510"},"PeriodicalIF":2.8000,"publicationDate":"2025-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12303669/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Yonsei Medical Journal","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3349/ymj.2024.0198","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: Black-blood (BB) magnetic resonance images (MRI) offer superior image contrast for the detection and segmentation of brain metastases (BMs). This study investigated the efficacy and accuracy of deep learning (DL) architectures and post-processing for BMs detection and segmentation with BB images.
Materials and methods: The BB images of 50 patients were collect to train (40) and test (10) the DL model. To ensure consistency, we implemented piecewise linear histogram matching for intensity normalization and resampling. Modified U-Net, including combination with generative adversarial network (GAN), was applied to enhance the segmentation performance. The U-Net-based networks generated bounding boxes indicating regions of interest, which were then processed in a post-processing using the Segment Anything Model (SAM). We quantitatively assessed the three U-Net-based models and their post-processed counterparts in terms of lesion-wise sensitivity (LWS), patient-wise dice similarity coefficient (DSC), and average false-positive rate (FPR).
Results: The modified U-Net with GAN yielded a patient-wise DSC of 0.853 and a LWS of 89.19%, which outperformed the standard U-Net (patient-wise DSC of 0.815) and modified U-Net only (patient-wise DSC of 0.846). Combining GAN architecture with modified U-Net also reduced the FPR, less than 1 on average. Post-processing with SAM further did not affect LWS and FPR, but effectively enhanced the patient-wise DSC by 2%-3% for the U-Net-based models.
Conclusion: The modifications to standard U-Net notably improves the detection and segmentation of BMs in BB images, and applying SAM as post-processing can further enhance the precision of segmentation results.
期刊介绍:
The goal of the Yonsei Medical Journal (YMJ) is to publish high quality manuscripts dedicated to clinical or basic research. Any authors affiliated with an accredited biomedical institution may submit manuscripts of original articles, review articles, case reports, brief communications, and letters to the Editor.