Houliang Zhou, Lifang He, Yu Zhang, Li Shen, Brian Chen
{"title":"Interpretable Graph Convolutional Network Of Multi-Modality Brain Imaging For Alzheimer’s Disease Diagnosis","authors":"Houliang Zhou, Lifang He, Yu Zhang, Li Shen, Brian Chen","doi":"10.1109/ISBI52829.2022.9761449","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761449","url":null,"abstract":"Identification of brain regions related to the specific neurological disorders are of great importance for biomarker and diagnostic studies. In this paper, we propose an interpretable Graph Convolutional Network (GCN) framework for the identification and classification of Alzheimer’s disease (AD) using multi-modality brain imaging data. Specifically, we extended the Gradient Class Activation Mapping (Grad-CAM) technique to quantify the most discriminative features identified by GCN from brain connectivity patterns. We then utilized them to find signature regions of interest (ROIs) by detecting the difference of features between regions in healthy control (HC), mild cognitive impairment (MCI), and AD groups. We conducted the experiments on the ADNI database with imaging data from three modalities, including VBM-MRI, FDG-PET, and AV45-PET, and showed that the ROI features learned by our method were effective for enhancing the performances of both clinical score prediction and disease status identification. It also successfully identified biomarkers associated with AD and MCI.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"31 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81205330","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Incremental Learning for a Flexible CAD System Design","authors":"Prathyusha Akundi, J. Sivaswamy","doi":"10.1109/ISBI52829.2022.9761688","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761688","url":null,"abstract":"Deep neural networks suffer from Catastrophic Forgetting (CF) on old tasks when they are trained to learn new tasks sequentially, since the parameters of the model will change to optimize on the new class. The problem of alleviating CF is of interest to Computer aided diagnostic (CAD) systems community to facilitate class incremental learning (IL): learn new classes as and when new data/annotations are made available and old data is no longer accessible. However, IL has not been explored much in CAD development. We propose a novel approach that ensures that a model remembers the causal factor behind the decisions on the old classes, while incrementally learning new classes. We introduce a common auxiliary task during the course of incremental training, whose hidden representations are shared across all the classification heads. Since the hidden representation is no longer task-specific, it leads to a significant reduction in CF. We demonstrate our approach by incrementally learning 5 different tasks on Chest-Xrays and compare the results with the state-of-the-art regularization methods. Our approach performs consistently well in reducing CF in all the tasks with almost zero CF in most of the cases unlike standard regularisation-based approaches.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"1 1","pages":"1-4"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81507393","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Noa Cahan, E. Marom, S. Soffer, Y. Barash, E. Konen, E. Klang, H. Greenspan
{"title":"Weakly Supervised Multimodal 30-Day All-Cause Mortality Prediction for Pulmonary Embolism Patients","authors":"Noa Cahan, E. Marom, S. Soffer, Y. Barash, E. Konen, E. Klang, H. Greenspan","doi":"10.1109/ISBI52829.2022.9761700","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761700","url":null,"abstract":"Pulmonary embolism (PE) is a common life-threatening condition with a challenging diagnosis, as patients often present with nonspecific symptoms. Prompt and accurate detection of PE and specifically an assessment of its severity are critical for managing patient treatment. We introduce diverse multimodal fusion models that are capable of utilizing weakly-labeled multi-modal data, combining both volumetric pixel data and clinical patient data for automatic risk stratification of PE. The best performing multimodality model is an intermediate fusion model that achieves an area under the curve (AUC) of 0.96 for assessing PE severity, with a sensitivity of 90% and specificity of 94%. To the best of our knowledge, this is the first study that attempted to automatically assess PE severity.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"1 1","pages":"1-4"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88244681","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Disentangled Representation of Longitudinal Β-Amyloid for AD Via Sequential Graph Variational Autoencoder with Supervision","authors":"Fan Yang, Guorong Wu, Won Hwa Kim","doi":"10.1109/ISBI52829.2022.9761588","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761588","url":null,"abstract":"The emergence of Positron Emission Tomography (PET) imaging allows us to quantify the burden of amyloid plaques in-vivo, which is one of the hallmarks of Alzheimer’s disease (AD). However, the invasive exposure to radiation and high imaging cost significantly restrict the application of PET in characterizing the evolution of pathology burden which often requires longitudinal PET image sequences. In this regard, we propose a proof-of-concept solution to generate the complete trajectory of pathological events throughout the brain based on very limited number of PET scans. We present a novel variational autoencoder model to learn a latent population-level representation of neurodegeneration process based on the longitudinal β-amyloid measurements at each brain region and longitudinal diagnostic stages. As the propagation of pathological burdens follow the topology of brain connectome, we further cast our neural network into a supervised sequential graph VAE, where we use the brain network to guide the representation learning. Experiments show that the disentangled representation can capture disease-related dynamics of amyloid and forecast the level of amyloid depositions at future time points.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"1 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91292639","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mounir Lahlouh, Y. Chenoune, R. Blanc, J. Szewczyk, Nicolas Passat
{"title":"Aortic Arch Anatomy Characterization from MRA: A CNN-Based Segmentation Approach","authors":"Mounir Lahlouh, Y. Chenoune, R. Blanc, J. Szewczyk, Nicolas Passat","doi":"10.1109/ISBI52829.2022.9761708","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761708","url":null,"abstract":"Neurovascular pathologies are often treated with the help of imaging to guide catheters inside arteries. However, positioning a microcatheter into the aortic arch and threading it through blood vessels for embolization, mechanical thrombectomy or stenting is a challenging task. Indeed, adverse aortic arch anatomies are frequently encountered, especially when the aortic arch is dilated, or the supra-aortic branches are elongated and tortuous. In this article, we propose a pipeline using convolutional neural networks for the segmentation of the aortic arch from magnetic resonance images for further anatomy classification purpose. This pipeline is composed of two successive modules, dedicated to the localization and the accurate segmentation of the aortic arch and the origin of supra-aortic branches, respectively. These segmentations are then used to generate 3D models from which the anatomy and the type of the aortic arches can be characterized. A quantitative evaluation of this approach, carried out on various U-Net architectures and different optimizers, leads to satisfactory segmentation results, then allowing a reliable characterization.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"2 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91334649","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Two-Stage Topological Refinement Network for Retinal Artery/Vein Classification","authors":"Shichen Luo, Zhan Heng, M. Pagnucco, Yang Song","doi":"10.1109/ISBI52829.2022.9761669","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761669","url":null,"abstract":"Automated retinal artery/vein (A/V) classification could significantly speed up computer-aided diagnosis of various cardiovascular and systemic diseases. Despite the successful application of deep learning methods to A/V segmentation and classification, exploiting topological information in deep learning methods remains a challenging task. We propose a novel two-stage cascaded deep learning framework to spread the workload across a U-Net with dual decoders and a topological refinement GAN, with a focus on the pixel-level features and topological features respectively. The proposed framework accomplishes state-of-the-art performance in A/V classification on the public AV-DRIVE, INSPIRE-AVR and LES-AV datasets and effectively improves the topological connectedness of the classification results.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"4 1","pages":"1-4"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87621051","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Divij G. Singh, Ayush Somani, A. Horsch, Dilip K. Prasad
{"title":"Counterfactual Explainable Gastrointestinal and Colonoscopy Image Segmentation","authors":"Divij G. Singh, Ayush Somani, A. Horsch, Dilip K. Prasad","doi":"10.1109/ISBI52829.2022.9761664","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761664","url":null,"abstract":"Segmenting medical images accurately and reliably is crucial for disease diagnosis and treatment. Due to the wide assortment of objects’ sizes, shapes, and scanning modalities, it has become more challenging. Many convolutional neural networks (CNN) have recently been designed for segmentation tasks and achieved great success. This paper presents an optimized deep learning solution using DeepLabv3+ with ResNet-101 as its backbone. The proposed approach allows capturing variabilities of diverse objects. It provides improved and reliable quantitative and qualitative results in comparison to other state-of-the-art (SOTA) methods on two publicly available gastrointestinal and colonoscopy datasets. Few studies show the inadequacy of stable performance in varying object segmentation tasks, notwithstanding the sizes of objects. Our method has stable performance in the segmentation of large and small medical objects. The explainability of our robust model with benchmarking on SOTA approaches for both datasets will be fruitful for further research on biomedical image segmentation.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"210 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91021751","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Weakly-Supervised Lesion Segmentation with Self-Guidance by CT Intensity Clustering","authors":"Xueyu Zhu, A. J. Ma","doi":"10.1109/ISBI52829.2022.9761552","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761552","url":null,"abstract":"To aid clinicians diagnose diseases and monitor lesion conditions more efficiently, automated lesion segmentation is a convincing approach. As it is time-consuming and costly to obtain pixel-level annotations, weakly-supervised learning has become a promising trend. Recent works based on Class Activation Mapping (CAM) achieve success for natural images, but they have not fully utilized the intensity property in medical images such that the performance may not be good enough. In this work, we propose a novel weakly-supervised lesion segmentation framework with self-guidance by CT intensity clustering. The proposed method takes full advantages of the properties that CT intensity represents the density of materials and partitions pixels into different groups by intensity clustering. Clusters with high lesion probability determined by the CAM are selected to generate lesion masks. Such lesion masks are used to derive self-guided loss functions which improve the CAM for better lesion segmentation. Our method achieves the Dice score of 0.5874 on the COVID-19 dataset and 0.4534 on the Liver Tumor Segmentation Challenge (LiTS) dataset.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"27 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73580829","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alvaro Fernandez-Quilez, T. Eftestøl, S. R. Kjosavik, M. G. Olsen, K. Oppedal
{"title":"Multi-Planar T2W MRI for an Improved Prostate Cancer Lesion Classification","authors":"Alvaro Fernandez-Quilez, T. Eftestøl, S. R. Kjosavik, M. G. Olsen, K. Oppedal","doi":"10.1109/ISBI52829.2022.9761514","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761514","url":null,"abstract":"Prostate cancer (PCa) is the fifth leading cause of death world-wide. In spite of the urgency for a timely and accurate diagnostic, the current PCa diagnostic pathway suffers from over-diagnosis of indolent lesions and under-diagnosis of highly invasive ones. The advent of deep learning (DL) techniques has enabled automatic and accurate computer-assisted systems that rival human performance. However, current approaches for PCa diagnostic are heavily reliant on T2w axial MRI, which suffer from low out-of-plane resolution. Sagittal and coronal MRI scans are usually acquired by default along with the axial one but are generally ignored by DL classification algorithms. We propose a multi-stream approach to accommodate sagittal, coronal and axial planes and improve the performance of PCa lesion classification. We evaluate our method on a publicly available dataset and demonstrate that it provides better results when compared with a single-plane approach over a range of different DL architectures.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"44 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74128289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adaptation of a Multi-Site Network to a New Clinical Site Via Batch-Normalization Similarity","authors":"Shira Kasten Serlin, J. Goldberger, H. Greenspan","doi":"10.1109/ISBI52829.2022.9761487","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761487","url":null,"abstract":"This paper tackles the challenging problem of medical site adaptation; i.e., learning a model from multi-site source data such that it can be modified and adapted to a new site using only unlabeled data from the new site. The method is based on Domain Specific Batch Normalization architecture and uses the Batch Normalization statistics of the new site to find the most similar internal site. The similarity measure is computed in an embedded space of the BN parameters. We evaluated our method on the task of MRI prostate segmentation. Public datasets from six different institutions were used, containing distribution shifts. The experimental results show that the proposed approach outperforms other generalization and adaptation methods.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"14 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75247002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}