{"title":"医学图像非配对循环翻译的严格有界深度网络","authors":"Swati Rai, Jignesh S. Bhatt, S. K. Patra","doi":"10.1109/SSP53291.2023.10207960","DOIUrl":null,"url":null,"abstract":"Medical image translation is an ill-posed problem. Unlike existing networks, we consider unpaired medical images as input, and provide a strictly bound generative network that yields a stable cyclic (bidirectional) translation. It consists of two cyclically connected conditional GANs where both generators (32 layers each) are conditioned with concatenation of alternate unpaired patches from input and target images of the same organ. The key idea is to exploit cross-neighborhood contextual feature information to bound translation space and boost generalization. Further, the generators are equipped with adaptive dictionaries which are learned from the cross-contextual patches to reduce possible degradation. Discriminators are 15-layer deep networks which employ minimax function to validate the translated imagery. A combined loss function is formulated with adversarial, non-adversarial, forward-backward cyclic, and identity losses that further minimize variance of the proposed learning machine. Qualitative, quantitative, and ablation analysis show superior results on real CT and MRI datasets.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"61 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Strictly Bounded Deep Network for Unpaired Cyclic Translation of Medical Images\",\"authors\":\"Swati Rai, Jignesh S. Bhatt, S. K. Patra\",\"doi\":\"10.1109/SSP53291.2023.10207960\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Medical image translation is an ill-posed problem. Unlike existing networks, we consider unpaired medical images as input, and provide a strictly bound generative network that yields a stable cyclic (bidirectional) translation. It consists of two cyclically connected conditional GANs where both generators (32 layers each) are conditioned with concatenation of alternate unpaired patches from input and target images of the same organ. The key idea is to exploit cross-neighborhood contextual feature information to bound translation space and boost generalization. Further, the generators are equipped with adaptive dictionaries which are learned from the cross-contextual patches to reduce possible degradation. Discriminators are 15-layer deep networks which employ minimax function to validate the translated imagery. A combined loss function is formulated with adversarial, non-adversarial, forward-backward cyclic, and identity losses that further minimize variance of the proposed learning machine. Qualitative, quantitative, and ablation analysis show superior results on real CT and MRI datasets.\",\"PeriodicalId\":296346,\"journal\":{\"name\":\"2023 IEEE Statistical Signal Processing Workshop (SSP)\",\"volume\":\"61 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE Statistical Signal Processing Workshop (SSP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SSP53291.2023.10207960\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE Statistical Signal Processing Workshop (SSP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SSP53291.2023.10207960","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Strictly Bounded Deep Network for Unpaired Cyclic Translation of Medical Images
Medical image translation is an ill-posed problem. Unlike existing networks, we consider unpaired medical images as input, and provide a strictly bound generative network that yields a stable cyclic (bidirectional) translation. It consists of two cyclically connected conditional GANs where both generators (32 layers each) are conditioned with concatenation of alternate unpaired patches from input and target images of the same organ. The key idea is to exploit cross-neighborhood contextual feature information to bound translation space and boost generalization. Further, the generators are equipped with adaptive dictionaries which are learned from the cross-contextual patches to reduce possible degradation. Discriminators are 15-layer deep networks which employ minimax function to validate the translated imagery. A combined loss function is formulated with adversarial, non-adversarial, forward-backward cyclic, and identity losses that further minimize variance of the proposed learning machine. Qualitative, quantitative, and ablation analysis show superior results on real CT and MRI datasets.