{"title":"Spatially-Preserving Flattening for Location-Aware Classification of Findings in Chest X-Rays","authors":"Neha Srivathsa, Razi Mahmood, T. Syeda-Mahmood","doi":"10.1109/ISBI52829.2022.9761630","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761630","url":null,"abstract":"Chest X-rays have become the focus of vigorous deep learning research in recent years due to the availability of large labeled datasets. While classification of anomalous findings is now possible, ensuring that they are correctly localized still remains challenging, as this requires recognition of anomalies within anatomical regions. Existing deep learning networks for fine-grained anomaly classification learn location-specific findings using architectures where the location and spatial contiguity information is lost during the flattening step before classification. In this paper, we present a new spatially preserving deep learning network that preserves location and shape information through auto-encoding of feature maps during flattening. The feature maps, auto-encoder and classifier are then trained in an end-to-end fashion to enable location aware classification of findings in chest X-rays. Results are shown on a large multi-hospital chest X-ray dataset indicating a significant improvement in the quality of finding classification over state-of-the-art methods.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"258 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77086136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"TDM-Stargan: Stargan Using Time Difference Map to Generate Dynamic Contrast-Enhanced Mri from Ultrafast Dynamic Contrast-Enhanced Mri","authors":"Young-Tack Oh, Eunsook Ko, Hyunjin Park","doi":"10.1109/ISBI52829.2022.9761463","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761463","url":null,"abstract":"Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is a sensitive imaging technique to manage many types of cancer including breast cancer. The conventional DCE-MRI takes a long time (7-12 minutes) to acquire and there is a clinical need to reduce scan time. Ultrafast DCE-MRI takes less than a minute to acquire and has sufficient information relative to conventional DCE-MRI. We propose a generative adversarial network (GAN) to generate the delay phase of synthetic conventional DCE-MRI from ultrafast DCE-MRI. We allow our model to better generate the area expected to be a lesion through the difference map of different phases to incorporate time-varying enhancement patterns. The difference map also allows us to generate pseudo tumor labels for segmentation. Our approach was trained and tested on 300 cases using three evaluation metrics. Our method showed better performance (structural similarity index map increase of 11.69%) compared to Pix2Pix baseline method.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"115 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76246835","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Faster R-CNN for IPSC-Derived Mesenchymal Stromal Cells Senescent Detection from Bright-Field Microscopy","authors":"Mingzhu Li, Liang He, Xinglie Wang, Tianfu Wang, Guanghui Yue, Guangqian Zhou, Baiying Lei","doi":"10.1109/ISBI52829.2022.9761548","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761548","url":null,"abstract":"iPSC-derived mesenchymal stromal cells (iMSCs) play an important role in cell therapy and regenerative medicine, but the differentiation and proliferation ability of senescent iMSCs decline greatly, which will also bring heterogeneity and potential side effects. The whole senescent degree of iMSCs can only be obtained by vital stain. However, this process will cost a lot of manpower, money and time. To solve this problem, we apply deep learning for automated iMSCs senescent recognition, which can quickly and accurately get the senescent situation of single-cell without staining. The adopted Faster R-CNN uses ResNet as the backbone network with an FPN module. Experiments on the collected dataset show that our method has achieved a detection accuracy of 0.768 in the mixed test set of each generation of cells and the independent test set of each generation of cells.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"13 1","pages":"1-4"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80109791","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Transformer Graph Network for Coronary Plaque Localization in CCTA","authors":"Mario Viti, H. Talbot, N. Gogin","doi":"10.1109/ISBI52829.2022.9761646","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761646","url":null,"abstract":"Coronary CT angiography (CCTA) is the only non-invasive imaging technique that reliably depicts the anatomic extent of Coronary Artery Disease (CAD). While occlusion remains a highly predictive indicator of major cardiovascular events (MACE), there is growing evidence that the presence and characteristics of coronary atherosclerosis provide additional prognostic information. In CCTA calcified plaques display high-intensity Hounsfield Units (HU) representative features while more complex representations characterize high-risk soft plaques. As such, accurate identification and quantification is burdensome and time consuming because of the limited temporal, spatial and contrast resolutions of X-ray scanners. Despite the success of deep learning in medical imaging, automatic localization of coronary plaques and especially soft plaques remains a challenging subject in CCTA vessel analysis. For this study, 150 CCTA scans were retrospectively collected. All patients were accepted at triage with minimal to severe CAD suspicion. Selection was carried out with uniform CAD-RADS severity distribution which normally follows an exponential decay function, thus obtaining a higher than normal concentration of plaques. The proposed method outperforms the state of the art for the localization of diverse types of plaques by exploiting the self-attention mechanism of transformers networks to embed contextual features of the coronary tree.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"52 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79044445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Differentiable Projection from Optical Coherence Tomography B-Scan without Retinal Layer Segmentation Supervision","authors":"Dingyi Rong, Jiancheng Yang, Bingbing Ni, B. Ke","doi":"10.1109/ISBI52829.2022.9761656","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761656","url":null,"abstract":"Projection map (PM) from optical coherence tomography (OCT) B-scan is an important tool to diagnose retinal diseases, which typically requires retinal layer segmentation. In this study, we present a novel end-to-end framework to predict PMs from B-scans. Instead of segmenting retinal layers explicitly, we represent them implicitly as predicted coordinates. By pixel interpolation on uniformly sampled coordinates between retinal layers, the corresponding PMs could be easily obtained with pooling. Notably, all the operators are differentiable; therefore, this Differentiable Projection Module (DPM) enables end-to-end training with the ground truth of PMs rather than retinal layer segmentation. Our framework produces high-quality PMs, significantly outperforming baselines, including a vanilla CNN without DPM and an optimization-based DPM without a deep prior. Furthermore, the proposed DPM, as a novel neural representation of areas/volumes between curves/surfaces, could be of independent interest for geometric deep learning.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"75 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79692338","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Generation of 12-Lead Electrocardiogram with Subject-Specific, Image-Derived Characteristics Using a Conditional Variational Autoencoder","authors":"Yuling Sang, M. Beetz, V. Grau","doi":"10.1109/ISBI52829.2022.9761431","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761431","url":null,"abstract":"Deep learning models have proven their value in the analysis of electrocardiogram (ECG). Among these, deep generative models have shown their ability in ECG generation. In this paper, we propose a conditional variational autoencoder (cVAE) to automatically generate realistic 12-lead ECG signals. Our method differs from previous papers in that (i) it generates complete 12-lead studies and (ii) generated ECGs can be adjusted to correspond to specific subject characteristics, particularly those from images. We demonstrate the ability of the model to adjust to age, sex and Body Mass Index (BMI) values. Our model is the first to incorporate imaging information by including heart position and orientation as input conditions, to analyse anatomical influences on generated ECG morphology. The network shows high accuracy and sensitivity to different conditions. In addition, our method can extract a ten-dimensional latent space containing interpreted features of the 12 ECG leads, which correspond to interpretable ECG features.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"68 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79871778","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Quantifying Newly Appearing Replication FOCI in Cell Nuclei Based on 3d Non-Rigid Registration","authors":"Qi Gao, Vadim O. Chagin, M. C. Cardoso, K. Rohr","doi":"10.1109/ISBI52829.2022.9761689","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761689","url":null,"abstract":"Studying the dynamics of replication foci (RFi) in live cell microscopy images is important to understand the principles of DNA replication during the cell cycle. Whether new RFi appear in proximity to existing ones or randomly remains unclear. We propose two new methods to quantify newly appearing RFi which represent global and local spatial information. One method is based on proportion curves and a proximity score, and the second method is based on proximity distribution maps. In addition, to align the 3D temporal microscopy image sequences and improve quantification, we introduce a 3D elasticity model-based image registration method. Experiments using synthetic image data demonstrate the effectiveness of the proposed methods. We also show analysis results of appearing RFi in real confocal microscopy images.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"4 1","pages":"1-4"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88752481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yu Fu, Yanyan Huang, Meng Niu, Le Xue, Shunjie Dong, Shunlin Guo, J. Lei, Cheng Zhuo
{"title":"Active Index: An Integrated Index to Reveal Disrupted Brain Network Organizations of Major Depressive Disorder Patients","authors":"Yu Fu, Yanyan Huang, Meng Niu, Le Xue, Shunjie Dong, Shunlin Guo, J. Lei, Cheng Zhuo","doi":"10.1109/ISBI52829.2022.9761503","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761503","url":null,"abstract":"Altered functional brain networks have been a typical manifestation that distinguishes major depressive disorder (MDD) patients from healthy control (HC) subjects in functional magnetic resonance imaging (fMRI) studies. Recently, rich club and diverse club metrics have been proposed for network or network neuroscience analyses. The rich club defines a set of nodes that tend to be the hubs of specific communities, and the diverse club defines the nodes that span more communities and have edges diversely distributed across different communities. Considering the heterogeneity of rich clubs and diverse clubs, combining them and on the basis to derive a novel indicator may reveal new evidence of brain functional integration and separation, which might provide new insights into MDD. This study for the first time discussed the differences between MDD and HC using both rich club and diverse club metrics and found the complementarity of them in analyzing brain networks. Besides, a novel index, termed \"active index\", has been proposed in this study. The active index defines a group of nodes that tend to be diversely distributed across communities while avoiding being a hub of a community. Experimental results demonstrate the superiority of active index in analyzing MDD brain mechanisms.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"133 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86330357","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Joint Attention for Medical Image Segmentation","authors":"Mo Zhang, Bin Dong, Quanzheng Li","doi":"10.1109/ISBI52829.2022.9761624","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761624","url":null,"abstract":"Medical image segmentation is crucial for computer aided diagnosis. In recent years, spatial attention mechanisms have leaded to breakthroughs in the task of image segmentation. In this work, we firstly present a unified formula for spatial attention mechanisms. Within this framework, we find that point-wise attention has better localization while self-attention can learn more global features. Motivated by this observation, we then propose a new joint attention module, which jointly leverages the advantages of point-wise attention and self-attention. Moreover, by integrating joint attention with DenseUNet, we conduct image segmentation experiments on two public datasets. The proposed method outperforms recent state-of-the-art models, verifying the superiority of joint attention. Additionally, ablation studies demonstrate that our joint attention obtains more balanced results compared to the previous point-wise attention and self-attention. The design of joint attention provides a novel insight into understanding spatial attention mechanisms.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"56 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81488777","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
F. Sobhani, A. Hamidinekoo, A. Hall, Lorraine M. King, J. Marks, C. Maley, H. Horlings, E. Hwang, Yinyin Yuan
{"title":"Automated Dcis Identification From Multiplex Immunohistochemistry Using Generative Adversarial Networks","authors":"F. Sobhani, A. Hamidinekoo, A. Hall, Lorraine M. King, J. Marks, C. Maley, H. Horlings, E. Hwang, Yinyin Yuan","doi":"10.1109/ISBI52829.2022.9761413","DOIUrl":"https://doi.org/10.1109/ISBI52829.2022.9761413","url":null,"abstract":"Ductal Carcinoma In Situ (DCIS) is a non-obligatory precursor of Invasive Breast Cancer. It is the most common mammographically detected breast cancer. Predicting DCIS progression to invasive ductal carcinoma is a major clinical challenge due to the lack of a uniform classification system in the diagnosis and prognostication of this disease. To characterise the tissue microecology of DCIS, we proposed and tested the model \"DCIS-Identification model\" based on Generative Adversarial Networks (GAN) for detection and segmentation of DCIS ducts from multiplex immunohistochemistry (IHC) staining samples. We also trained a Spatially Constrained Convolutional Neural Network (SC-CNN) to detect and classify single cells based on their CA9 and FOXP3 expression. The DCIS-Identification model was evaluated on 8 whole slide images, resulting in an average Dice score of 0.95 for the segmentation performance. The single cell identification framework was tested on 10 randomly selected whole slide sections, achieving the average accuracy of 88.6% in a 5 fold cross validation scheme. With the proposed pipeline, we efficiently integrated deep learning, computational pathology and spatial statistics to report distinct differences in the microenvironments of DCIS and IDC/DCIS samples. The proposed pipeline provides a tool for a better understanding of the mechanism of tumours in DCIS and IDC/DCIS cases.","PeriodicalId":6827,"journal":{"name":"2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI)","volume":"3 1","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78360315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}