{"title":"基于多相信息融合框架和时空预测模块的四相 CT 病灶识别。","authors":"Shaohua Qiao, Mengfan Xue, Yan Zuo, Jiannan Zheng, Haodong Jiang, Xiangai Zeng, Dongliang Peng","doi":"10.1186/s12938-024-01297-x","DOIUrl":null,"url":null,"abstract":"<p><p>Multiphase information fusion and spatiotemporal feature modeling play a crucial role in the task of four-phase CT lesion recognition. In this paper, we propose a four-phase CT lesion recognition algorithm based on multiphase information fusion framework and spatiotemporal prediction module. Specifically, the multiphase information fusion framework uses the interactive perception mechanism to realize the channel-spatial information interactive weighting between multiphase features. In the spatiotemporal prediction module, we design a 1D deep residual network to integrate multiphase feature vectors, and use the GRU architecture to model the temporal enhancement information between CT slices. In addition, we employ CT image pseudo-color processing for data augmentation and train the whole network based on a multi-task learning framework. We verify the proposed network on a four-phase CT dataset. The experimental results show that the proposed network can effectively fuse the multi-phase information and model the temporal enhancement information between CT slices, showing excellent performance in lesion recognition.</p>","PeriodicalId":8927,"journal":{"name":"BioMedical Engineering OnLine","volume":"23 1","pages":"103"},"PeriodicalIF":2.9000,"publicationDate":"2024-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11492744/pdf/","citationCount":"0","resultStr":"{\"title\":\"Four-phase CT lesion recognition based on multi-phase information fusion framework and spatiotemporal prediction module.\",\"authors\":\"Shaohua Qiao, Mengfan Xue, Yan Zuo, Jiannan Zheng, Haodong Jiang, Xiangai Zeng, Dongliang Peng\",\"doi\":\"10.1186/s12938-024-01297-x\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Multiphase information fusion and spatiotemporal feature modeling play a crucial role in the task of four-phase CT lesion recognition. In this paper, we propose a four-phase CT lesion recognition algorithm based on multiphase information fusion framework and spatiotemporal prediction module. Specifically, the multiphase information fusion framework uses the interactive perception mechanism to realize the channel-spatial information interactive weighting between multiphase features. In the spatiotemporal prediction module, we design a 1D deep residual network to integrate multiphase feature vectors, and use the GRU architecture to model the temporal enhancement information between CT slices. In addition, we employ CT image pseudo-color processing for data augmentation and train the whole network based on a multi-task learning framework. We verify the proposed network on a four-phase CT dataset. The experimental results show that the proposed network can effectively fuse the multi-phase information and model the temporal enhancement information between CT slices, showing excellent performance in lesion recognition.</p>\",\"PeriodicalId\":8927,\"journal\":{\"name\":\"BioMedical Engineering OnLine\",\"volume\":\"23 1\",\"pages\":\"103\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-10-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11492744/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"BioMedical Engineering OnLine\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1186/s12938-024-01297-x\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"BioMedical Engineering OnLine","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1186/s12938-024-01297-x","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
Four-phase CT lesion recognition based on multi-phase information fusion framework and spatiotemporal prediction module.
Multiphase information fusion and spatiotemporal feature modeling play a crucial role in the task of four-phase CT lesion recognition. In this paper, we propose a four-phase CT lesion recognition algorithm based on multiphase information fusion framework and spatiotemporal prediction module. Specifically, the multiphase information fusion framework uses the interactive perception mechanism to realize the channel-spatial information interactive weighting between multiphase features. In the spatiotemporal prediction module, we design a 1D deep residual network to integrate multiphase feature vectors, and use the GRU architecture to model the temporal enhancement information between CT slices. In addition, we employ CT image pseudo-color processing for data augmentation and train the whole network based on a multi-task learning framework. We verify the proposed network on a four-phase CT dataset. The experimental results show that the proposed network can effectively fuse the multi-phase information and model the temporal enhancement information between CT slices, showing excellent performance in lesion recognition.
期刊介绍:
BioMedical Engineering OnLine is an open access, peer-reviewed journal that is dedicated to publishing research in all areas of biomedical engineering.
BioMedical Engineering OnLine is aimed at readers and authors throughout the world, with an interest in using tools of the physical and data sciences and techniques in engineering to understand and solve problems in the biological and medical sciences. Topical areas include, but are not limited to:
Bioinformatics-
Bioinstrumentation-
Biomechanics-
Biomedical Devices & Instrumentation-
Biomedical Signal Processing-
Healthcare Information Systems-
Human Dynamics-
Neural Engineering-
Rehabilitation Engineering-
Biomaterials-
Biomedical Imaging & Image Processing-
BioMEMS and On-Chip Devices-
Bio-Micro/Nano Technologies-
Biomolecular Engineering-
Biosensors-
Cardiovascular Systems Engineering-
Cellular Engineering-
Clinical Engineering-
Computational Biology-
Drug Delivery Technologies-
Modeling Methodologies-
Nanomaterials and Nanotechnology in Biomedicine-
Respiratory Systems Engineering-
Robotics in Medicine-
Systems and Synthetic Biology-
Systems Biology-
Telemedicine/Smartphone Applications in Medicine-
Therapeutic Systems, Devices and Technologies-
Tissue Engineering