{"title":"Self Supervised Lesion Recognition for Breast Ultrasound Diagnosis","authors":"Yuanfan Guo, Canqian Yang, Tiancheng Lin, Chunxiao Li, Rui Zhang, Yi Xu","doi":"10.1109/ISBI52829.2022.9761701","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761701","url":null,"abstract":"Previous deep learning based Computer Aided Diagnosis (CAD) system treats multiple views of the same lesion as independent images. Since an ultrasound image only describes a partial 2D projection of a 3D lesion, such paradigm ignores the semantic relationship between different views of a lesion, which is inconsistent with the traditional diagnosis where sonographers analyze a lesion from at least two views. In this paper, we propose a multi-task framework that complements Benign/Malignant classification task with lesion recognition (LR) which helps leveraging relationship among multiple views of a single lesion to learn a complete representation of the lesion. To be specific, LR task employs contrastive learning to encourage representation that pulls multiple views of the same lesion and repels those of different lesions. The task therefore facilitates a representation that is not only invariant to the view change of the lesion, but also capturing fine-grained features to distinguish between different lesions. Experiments show that the proposed multi-task framework boosts the performance of Benign/Malignant classification as two sub-tasks complement each other and enhance the learned representation of ultrasound images.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"182 1","pages":"1-4"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85449260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Brian C. Lee, Ayushi Sinha, N. Varble, W. Pritchard, J. Karanian, B. Wood, T. Bydlon
{"title":"Breathing-Compensated Neural Networks for Real Time C-Arm Pose Estimation in Lung CT-Fluoroscopy Registration","authors":"Brian C. Lee, Ayushi Sinha, N. Varble, W. Pritchard, J. Karanian, B. Wood, T. Bydlon","doi":"10.1109/ISBI52829.2022.9761705","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761705","url":null,"abstract":"Augmentation of interventional c-arm fluoroscopy using information extracted from pre-operative imaging has the potential to reduce procedure times and improve patient outcomes in minimally invasive peripheral lung procedures, where breathing motion, small airways, and anatomical variation create a challenging environment for planned pathway navigation. Extraction of the rigid c-arm pose relative to preoperative images is a crucial prerequisite; however, accurate 2D-3D fluoroscopy-CT soft tissue registration in the presence of natural deformable patient motion remains challenging. We propose to train a patient-specific neural network on synthetic fluoroscopy derived from the patient’s pre-operative CT, augmented by a generalized breathing motion model, to predict c-arm pose. Our model includes an image supervision path that infers the x-ray projection geometry, providing training stability across patients. We train our model on synthetic fluoroscopy generated from preclinical swine CT and we evaluate on synthetic and real fluoroscopy.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"25 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72852165","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Roman Spilger, Ji Young Lee, R. Bartenschlager, K. Rohr
{"title":"Deep Neural Network for Combined Particle Tracking and Colocalization Analysis in Two-Channel Microscopy Images","authors":"Roman Spilger, Ji Young Lee, R. Bartenschlager, K. Rohr","doi":"10.1109/ISBI52829.2022.9761696","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761696","url":null,"abstract":"Analyzing protein dynamics in multi-channel fluorescence microscopy data is important to understand biological processes. We present a novel deep learning approach for combined particle tracking and colocalization analysis in two-channel microscopy image sequences. The approach is based on a convolutional long short-term memory network and exploits colocalization information to improve tracking. Short and long-term temporal dependencies of object motion as well as image intensities are taken into account to compute assignment probabilities jointly across multiple detections. Colocalization probabilities are also determined by the neural network. We evaluated the performance of the proposed approach based on synthetic images and real two-channel fluorescence microscopy data. It turned out that our approach outperforms previous methods.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"5 1","pages":"1-4"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77024618","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Data Driven Estimation of Covid-19 Prognosis","authors":"Harshit Sharma, R. Nagar, Deepak Mishra","doi":"10.1109/ISBI52829.2022.9761406","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761406","url":null,"abstract":"Continuous spread of novel coronavirus (COVID-19) and availability of limited resources force the severity-based allocation of resources. While it is essential to have a reliable severity assessment method, it is even more critical to have a prognosis model to estimate infection progress in individuals. An accurate estimate of infection progression would naturally help in optimized treatment and morbidity reduction. We aim at the prognosis of the COVID-19 infections including, ground-glass opacities, consolidation, and pleural effusion, from the longitudinal chest X-ray (CXR) images of the patient. For this purpose, we first propose a learning-based framework that predicts infection type from a given CXR image. This helps in finding low dimensional embeddings of CXR images, which we use in a recurrent learning framework to predict the type of infection for the subsequent days. We achieve a test AUC of 0.85 for infection type prediction and a test AUC of 0.88 for prognosis on the benchmark COVID-19 dataset.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"64 2 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76384003","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Guochen Ning, Hanying Liang, Lei Zhou, Xinran Zhang, Hongen Liao
{"title":"Spatial Position Estimation Method for 3D Ultrasound Reconstruction Based on Hybrid Transfomers","authors":"Guochen Ning, Hanying Liang, Lei Zhou, Xinran Zhang, Hongen Liao","doi":"10.1109/ISBI52829.2022.9761499","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761499","url":null,"abstract":"3D ultrasound reconstruction has important application value in clinical diagnosis. To obtain the spatial relationships between ultrasound images in reconstruction tasks, especially the contextual information in long-range sequences, this work proposes a spatial position estimation method for 3D ultrasound image reconstruction based on a hybrid transformer encoder. Inspired by the transformer sequence processing capability, we propose a joint local and global information encoding approach to improve the reconstruction accuracy. The proposed method consists of a backbone network for extracting local information of ultrasound images, and a transformer encoder for performing regression tasks on the global sequence. The experiment results indicated that our method can effectively reduce the cumulative error in the reconstruction task, especially in long sequences reconstruction.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"26 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76023898","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multi-Tasking DSSD Architecture for Laparoscopic Cholecystectomy Surgical Assistance Systems","authors":"Chakka Sai Pradeep, N. Sinha","doi":"10.1109/ISBI52829.2022.9761562","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761562","url":null,"abstract":"In this paper, we propose a novel DSSD based encoder-decoder multi-tasking architecture for the simultaneous tasks of (i) surgical tool presence detection, (ii) surgical tool localization and (iii) surgical phase classification - all on laparoscopic cholecystectomy surgical videos for the purpose of visual surgical assistance. Novelty of the study lies in addressing all the three tasks simultaneously with a single network architecture. Peak performance was achieved on m2cai16-tool-locations dataset at 97.51% mAP for the task of surgical tool presence detection, 91.9% mAP for the task of surgical tool localization (20% higher than SOTA), 97.77% accuracy for the task of surgical phase classification. This multi-tasking approach reduces the demand over training images needing only 2025 training images as against 2.3M images required otherwise. Besides, the approach needs only less than 30% of the model parameters than those that perform each of these tasks separately.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"70 1","pages":"1-4"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87514007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jiaxing Gao, Changhe Li, Zhibin He, Yaonai Wei, Lei Guo, Junwei Han, Shenmin Zhang, Tuo Zhang
{"title":"Prediction of Cognitive Scores by Movie-Watching FMRI Connectivity and Eye Movement Via Spectral Graph Convolutions","authors":"Jiaxing Gao, Changhe Li, Zhibin He, Yaonai Wei, Lei Guo, Junwei Han, Shenmin Zhang, Tuo Zhang","doi":"10.1109/ISBI52829.2022.9761565","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761565","url":null,"abstract":"Brain functional connectivity has been demonstrated to serve as a \"fingerprint\" to predict individual behaviors and phenotypes. A precise mapping between them could provide insightful clues to brain architectures and the generation of cognition. In this context, the naturalistic paradigm provides more engaging conditions and richer fMRI information, and both preserves or even enhances individual features and increases sensitivity to phenotypic measures, compared with other functional MRI modalities including resting-state and task paradigms. However, to the best of our knowledge, only linear methods were developed for predicting phenotypic measures from brain activity under naturalistic stimulus, while the brain activity is highly dynamic and nonlinear. Hence, we adopted the nonlinear graph convolutional network (GCN) to predict cognition-related phenotypic score from brain functional connectivity under naturalistic stimulus, where subjects are the nodes and functional connectivity is node feature. The behavior patterns of eye movement were integrated into this method to estimate similarity across subjects and define the graph edges. A few nodes are labeled by their phenotypic score, and the model is trained to predict the scores of those unlabeled nodes. The prediction accuracy of this method outperforms those from the linear classification method, resting-state based functional node feature and random edge tests.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"39 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86362635","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
K. Pooja, Zaccharie Ramzi, G. R. Chaithya, P. Ciuciu
{"title":"MC-PDNet: Deep Unrolled Neural Network For Multi-Contrast Mr Image Reconstruction From Undersampled K-Space Data","authors":"K. Pooja, Zaccharie Ramzi, G. R. Chaithya, P. Ciuciu","doi":"10.1109/ISBI52829.2022.9761583","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761583","url":null,"abstract":"Multi-contrast (MC) MR images are similar in structure and can leverage anatomical structure to perform joint reconstruction especially from a limited number of k-space data in the Compressed Sensing (CS) setting. However CS-based multi-contrast image reconstruction has shown limited performance in these highly accelerated regimes due to the use of hand-crafted group sparsity priors. Deep learning can improve outcomes by learning the joint prior across multiple weighting contrasts. In this work, we extend the primal-dual neural network (PDNet) in the multi-contrast sense. We propose a MC-PDNet architecture which takes full advantage of multi-contrast information. Using an in-house database consisting of images from T2TSE, T2*GRE and FLAIR contrasts acquired in 66 healthy volunteers, we performed a retrospective study from 4-fold under-sampled data. It was shown that MC-PDNet improves image quality by at least 1dB in PSNR for each contrast individually in comparison with PD-Net, U-Net and DISN-5B architectures.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":" 34","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91411692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Class-Based Attention Mechanism for Chest Radiograph Multi-Label Categorization","authors":"David Sriker, H. Greenspan, J. Goldberger","doi":"10.1109/ISBI52829.2022.9761667","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761667","url":null,"abstract":"This work focuses on a new methodology for class-based attention, which is an extension to the more common image-based attention mechanism. The class-based attention mechanism learns a different attention mask for each class. This enables to simultaneously apply a different localization procedure for different pathologies in the same image, thus important for a multilabel categorization. We apply the method to detect and localize a set of pathologies in chest Radiographs. The proposed network architecture was evaluated on publicly available X-ray datasets and yielded improved classification results compared to standard image based attention.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"1 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83154440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards Generalization of Medical Imaging AI Models: Sharpness-Aware Minimizers and Beyond","authors":"Deepak Anand, Rohan Patil, Utkarsh Agrawal, Rahul Venkataramani, Hariharan Ravishankar, Prasad Sudhakar","doi":"10.1109/ISBI52829.2022.9761677","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761677","url":null,"abstract":"AI models have become ubiquitous tools of choice for different medical imaging problems like enhancement, work-flow acceleration, etc.. While availability of large amounts of diverse data and reliable annotations continue to be a challenge, development cycles of these models have shrunk. This necessitates a reliable recipe for improving generalization of AI models that fare well during deployment on unseen data. In this paper, we investigate generalization through the lens of sharpness-aware optimizers. We study two representative problems in medical imaging: (a) a difficult task of cardiac view classification on ultrasound images and (b) COVID-19 detection from chest X-ray images and demonstrate high efficacy of flat minima solutions. Further, we perform extensive Hessian analysis that reveals the impact of the geometry of loss landscape towards generalization. Our empirical studies suggest that sharpness aware minimization improves generalization by 5−10%, over and above the gain obtained by other methods - on both in-domain and out-of-domain test data.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"1 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90598792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}