Dinghui Wu , Xueping Tan , Hao Wang , Zihao Zhao , Yuxi Ge , Shudong Hu , Rongrui Liang
{"title":"DMF-LP:通过使用扩散和拉普拉斯技术的多模态医学图像融合来提高图像质量","authors":"Dinghui Wu , Xueping Tan , Hao Wang , Zihao Zhao , Yuxi Ge , Shudong Hu , Rongrui Liang","doi":"10.1016/j.bspc.2025.107890","DOIUrl":null,"url":null,"abstract":"<div><div>Multimodal medical image fusion techniques are of great significance in medical diagnosis and treatment. Existing fusion methods are often difficult to effectively retain and integrate the texture information and features of the source images when dealing with medical images of different modalities, leading to obvious deficiencies in the visual performance and quantitative assessment of the fusion results. To address this problem, this paper proposes a multimodal medical image diffusion fusion model, referred to as DMF-LP. DMF-LP designs a LP-F module before the forward diffusion stage of the model, which performs pre-fusion of the source image pairs, and is used to extract and retain the texture information and features of the source images. In addition, in order to optimize the diffusion model training process, this paper incorporates the information entropy theory into the traditional loss function and constructs a multi-objective loss function, which is used to improve the model’s utilization of medical information and optimize the fusion effect. Experiments demonstrate that DMF-LP outperforms state-of-the-art methods across key metrics: SSIM (0.912 ± 0.011 vs. 0.897 ± 0.063 for DDFM), PSNR (34.416 ± 0.568 dB vs. 34.166 ± 1.093 dB for DDFM), and CC (0.980 ± 0.001 vs. 0.976 ± 0.006 for DDFM). Notably, DMF-LP achieves a 15.6% improvement in SSIM over traditional CNN-based approaches (0.912 vs. 0.869). At the same time, the final fused image maintains visual details and has high structural clarity, which proves the effectiveness of the DMF-LP method. Code is available at <span><span>https://gitee.com/tan-xueping/DMF-LP</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":55362,"journal":{"name":"Biomedical Signal Processing and Control","volume":"106 ","pages":"Article 107890"},"PeriodicalIF":4.9000,"publicationDate":"2025-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DMF-LP: Enhancing image quality through multimodal medical image fusion using diffusion and Laplacian techniques\",\"authors\":\"Dinghui Wu , Xueping Tan , Hao Wang , Zihao Zhao , Yuxi Ge , Shudong Hu , Rongrui Liang\",\"doi\":\"10.1016/j.bspc.2025.107890\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Multimodal medical image fusion techniques are of great significance in medical diagnosis and treatment. Existing fusion methods are often difficult to effectively retain and integrate the texture information and features of the source images when dealing with medical images of different modalities, leading to obvious deficiencies in the visual performance and quantitative assessment of the fusion results. To address this problem, this paper proposes a multimodal medical image diffusion fusion model, referred to as DMF-LP. DMF-LP designs a LP-F module before the forward diffusion stage of the model, which performs pre-fusion of the source image pairs, and is used to extract and retain the texture information and features of the source images. In addition, in order to optimize the diffusion model training process, this paper incorporates the information entropy theory into the traditional loss function and constructs a multi-objective loss function, which is used to improve the model’s utilization of medical information and optimize the fusion effect. Experiments demonstrate that DMF-LP outperforms state-of-the-art methods across key metrics: SSIM (0.912 ± 0.011 vs. 0.897 ± 0.063 for DDFM), PSNR (34.416 ± 0.568 dB vs. 34.166 ± 1.093 dB for DDFM), and CC (0.980 ± 0.001 vs. 0.976 ± 0.006 for DDFM). Notably, DMF-LP achieves a 15.6% improvement in SSIM over traditional CNN-based approaches (0.912 vs. 0.869). At the same time, the final fused image maintains visual details and has high structural clarity, which proves the effectiveness of the DMF-LP method. Code is available at <span><span>https://gitee.com/tan-xueping/DMF-LP</span><svg><path></path></svg></span>.</div></div>\",\"PeriodicalId\":55362,\"journal\":{\"name\":\"Biomedical Signal Processing and Control\",\"volume\":\"106 \",\"pages\":\"Article 107890\"},\"PeriodicalIF\":4.9000,\"publicationDate\":\"2025-05-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Biomedical Signal Processing and Control\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S174680942500401X\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Signal Processing and Control","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S174680942500401X","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
DMF-LP: Enhancing image quality through multimodal medical image fusion using diffusion and Laplacian techniques
Multimodal medical image fusion techniques are of great significance in medical diagnosis and treatment. Existing fusion methods are often difficult to effectively retain and integrate the texture information and features of the source images when dealing with medical images of different modalities, leading to obvious deficiencies in the visual performance and quantitative assessment of the fusion results. To address this problem, this paper proposes a multimodal medical image diffusion fusion model, referred to as DMF-LP. DMF-LP designs a LP-F module before the forward diffusion stage of the model, which performs pre-fusion of the source image pairs, and is used to extract and retain the texture information and features of the source images. In addition, in order to optimize the diffusion model training process, this paper incorporates the information entropy theory into the traditional loss function and constructs a multi-objective loss function, which is used to improve the model’s utilization of medical information and optimize the fusion effect. Experiments demonstrate that DMF-LP outperforms state-of-the-art methods across key metrics: SSIM (0.912 ± 0.011 vs. 0.897 ± 0.063 for DDFM), PSNR (34.416 ± 0.568 dB vs. 34.166 ± 1.093 dB for DDFM), and CC (0.980 ± 0.001 vs. 0.976 ± 0.006 for DDFM). Notably, DMF-LP achieves a 15.6% improvement in SSIM over traditional CNN-based approaches (0.912 vs. 0.869). At the same time, the final fused image maintains visual details and has high structural clarity, which proves the effectiveness of the DMF-LP method. Code is available at https://gitee.com/tan-xueping/DMF-LP.
期刊介绍:
Biomedical Signal Processing and Control aims to provide a cross-disciplinary international forum for the interchange of information on research in the measurement and analysis of signals and images in clinical medicine and the biological sciences. Emphasis is placed on contributions dealing with the practical, applications-led research on the use of methods and devices in clinical diagnosis, patient monitoring and management.
Biomedical Signal Processing and Control reflects the main areas in which these methods are being used and developed at the interface of both engineering and clinical science. The scope of the journal is defined to include relevant review papers, technical notes, short communications and letters. Tutorial papers and special issues will also be published.