Fatemeh Zabihollahy, Holden H Wu, Anthony E Sisk, Robert E Reiter, Steven S Raman, Neil E Fleshner, George M Yousef, KyungHyun Sung
{"title":"基于深度学习的前列腺全载组织病理与MRI配准的解剖感知形态模型。","authors":"Fatemeh Zabihollahy, Holden H Wu, Anthony E Sisk, Robert E Reiter, Steven S Raman, Neil E Fleshner, George M Yousef, KyungHyun Sung","doi":"10.1148/rycan.240336","DOIUrl":null,"url":null,"abstract":"<p><p>Purpose To develop and evaluate a novel deep learning-based approach for registering presurgical MR and whole-mount histopathology (WMHP) images of the prostate. Materials and Methods This retrospective study included patients who underwent prostate MRI before radical prostatectomy between July 2016 and June 2020. High-resolution ex vivo MRI was used as a reference to assess the structural relationship between in vivo MRI and WMHP. An Anatomy-Aware Morph model, a hybrid attention and convolutional neural network-based approach, was developed for multimodality prostate image registration. The pipeline included a module to estimate and correct distortion and motion between the prostate specimen and outside the human body. The dataset was divided into 270 and 45 patients for training and testing, respectively. Registration accuracy was evaluated using Dice similarity coefficient (DSC), Hausdorff distance, and target registration error. Results The proposed approach was validated using 160 images extracted from 45 male patients in the testing dataset with the average age ± SD of 64.0 years ± 6.6. The method achieved a DSC and Hausdorff distance of 0.95 ± 0.06 and 1.84 mm ± 0.38. The two-dimensional target registration errors between 90 sets of landmarks on in vivo MR images and WMHP images were 3.93 mm ± 0.80 and 1.18 mm ± 0.28 before and after registration (<i>P</i> < .001). The developed algorithm significantly outperformed the state-of-the-art VoxelMorph method for multimodality prostate image registration (<i>P</i> < .0001 for both DSC and Hausdorff distance). Conclusion The developed registration method successfully aligned presurgical prostate MR and histopathology images, facilitating automated mapping of prostate cancer from WMHP to MRI. <b>Keywords:</b> Affine Transformation, Deformable Registration, Prostate Magnetic Resonance Imaging, Prostate Whole-Mount Histopathology <i>Supplemental material is available for this article.</i> © RSNA, 2025.</p>","PeriodicalId":20786,"journal":{"name":"Radiology. Imaging cancer","volume":"7 3","pages":"e240336"},"PeriodicalIF":5.6000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12130720/pdf/","citationCount":"0","resultStr":"{\"title\":\"Deep Learning-based Anatomy-Aware Morph Model for Registration of Prostate Whole-Mount Histopathology to MRI.\",\"authors\":\"Fatemeh Zabihollahy, Holden H Wu, Anthony E Sisk, Robert E Reiter, Steven S Raman, Neil E Fleshner, George M Yousef, KyungHyun Sung\",\"doi\":\"10.1148/rycan.240336\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Purpose To develop and evaluate a novel deep learning-based approach for registering presurgical MR and whole-mount histopathology (WMHP) images of the prostate. Materials and Methods This retrospective study included patients who underwent prostate MRI before radical prostatectomy between July 2016 and June 2020. High-resolution ex vivo MRI was used as a reference to assess the structural relationship between in vivo MRI and WMHP. An Anatomy-Aware Morph model, a hybrid attention and convolutional neural network-based approach, was developed for multimodality prostate image registration. The pipeline included a module to estimate and correct distortion and motion between the prostate specimen and outside the human body. The dataset was divided into 270 and 45 patients for training and testing, respectively. Registration accuracy was evaluated using Dice similarity coefficient (DSC), Hausdorff distance, and target registration error. Results The proposed approach was validated using 160 images extracted from 45 male patients in the testing dataset with the average age ± SD of 64.0 years ± 6.6. The method achieved a DSC and Hausdorff distance of 0.95 ± 0.06 and 1.84 mm ± 0.38. The two-dimensional target registration errors between 90 sets of landmarks on in vivo MR images and WMHP images were 3.93 mm ± 0.80 and 1.18 mm ± 0.28 before and after registration (<i>P</i> < .001). The developed algorithm significantly outperformed the state-of-the-art VoxelMorph method for multimodality prostate image registration (<i>P</i> < .0001 for both DSC and Hausdorff distance). Conclusion The developed registration method successfully aligned presurgical prostate MR and histopathology images, facilitating automated mapping of prostate cancer from WMHP to MRI. <b>Keywords:</b> Affine Transformation, Deformable Registration, Prostate Magnetic Resonance Imaging, Prostate Whole-Mount Histopathology <i>Supplemental material is available for this article.</i> © RSNA, 2025.</p>\",\"PeriodicalId\":20786,\"journal\":{\"name\":\"Radiology. Imaging cancer\",\"volume\":\"7 3\",\"pages\":\"e240336\"},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2025-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12130720/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Radiology. Imaging cancer\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1148/rycan.240336\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ONCOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Radiology. Imaging cancer","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1148/rycan.240336","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0