{"title":"Introducing IEEE Collabratec","authors":"","doi":"10.1109/tmi.2021.3051831","DOIUrl":"https://doi.org/10.1109/tmi.2021.3051831","url":null,"abstract":"","PeriodicalId":13418,"journal":{"name":"IEEE Transactions on Medical Imaging","volume":" ","pages":""},"PeriodicalIF":10.6,"publicationDate":"2021-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/tmi.2021.3051831","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48197866","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Javad Fotouhi, Arian Mehrfard, Tianyu Song, Alex Johnson, Greg Osgood, Mathias Unberath, Mehran Armand, Nassir Navab
{"title":"Development and Pre-Clinical Analysis of Spatiotemporal-Aware Augmented Reality in Orthopedic Interventions.","authors":"Javad Fotouhi, Arian Mehrfard, Tianyu Song, Alex Johnson, Greg Osgood, Mathias Unberath, Mehran Armand, Nassir Navab","doi":"10.1109/TMI.2020.3037013","DOIUrl":"https://doi.org/10.1109/TMI.2020.3037013","url":null,"abstract":"<p><p>Suboptimal interaction with patient data and challenges in mastering 3D anatomy based on ill-posed 2D interventional images are essential concerns in image-guided therapies. Augmented reality (AR) has been introduced in the operating rooms in the last decade; however, in image-guided interventions, it has often only been considered as a visualization device improving traditional workflows. As a consequence, the technology is gaining minimum maturity that it requires to redefine new procedures, user interfaces, and interactions. The main contribution of this paper is to reveal how exemplary workflows are redefined by taking full advantage of head-mounted displays when entirely co-registered with the imaging system at all times. The awareness of the system from the geometric and physical characteristics of X-ray imaging allows the exploration of different human-machine interfaces. Our system achieved an error of 4.76 ± 2.91mm for placing K-wire in a fracture management procedure, and yielded errors of 1.57 ± 1.16° and 1.46 ± 1.00° in the abduction and anteversion angles, respectively, for total hip arthroplasty (THA). We compared the results with the outcomes from baseline standard operative and non-immersive AR procedures, which had yielded errors of [4.61mm, 4.76°, 4.77°] and [5.13mm, 1.78°, 1.43°], respectively, for wire placement, and abduction and anteversion during THA. We hope that our holistic approach towards improving the interface of surgery not only augments the surgeon's capabilities but also augments the surgical team's experience in carrying out an effective intervention with reduced complications and provide novel approaches of documenting procedures for training purposes.</p>","PeriodicalId":13418,"journal":{"name":"IEEE Transactions on Medical Imaging","volume":"40 2","pages":"765-778"},"PeriodicalIF":10.6,"publicationDate":"2021-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TMI.2020.3037013","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9087319","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"TechRxiv","authors":"","doi":"10.1109/tim.2020.3013577","DOIUrl":"https://doi.org/10.1109/tim.2020.3013577","url":null,"abstract":"","PeriodicalId":13418,"journal":{"name":"IEEE Transactions on Medical Imaging","volume":" ","pages":""},"PeriodicalIF":10.6,"publicationDate":"2020-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/tim.2020.3013577","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49086014","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multitask Deep Learning Reconstruction and Localization of Lesions in Limited Angle Diffuse Optical Tomography","authors":"Hanene Ben Yedder, Ben Cardoen, G. Hamarneh","doi":"10.36227/techrxiv.13150805","DOIUrl":"https://doi.org/10.36227/techrxiv.13150805","url":null,"abstract":"Diffuse optical tomography (DOT) leverages near-infrared light propagation through tissue to assess its optical properties and identify abnormalities. DOT image reconstruction is an ill-posed problem due to the highly scattered photons in the medium and the smaller number of measurements compared to the number of unknowns. Limited-angle DOT reduces probe complexity at the cost of increased reconstruction complexity. Reconstructions are thus commonly marred by artifacts and, as a result, it is difficult to obtain an accurate reconstruction of target objects, e.g., malignant lesions. Reconstruction does not always ensure good localization of small lesions. Furthermore, conventional optimization-based reconstruction methods are computationally expensive, rendering them too slow for real-time imaging applications. Our goal is to develop a fast and accurate image reconstruction method using deep learning, where multitask learning ensures accurate lesion localization in addition to improved reconstruction. We apply spatial-wise attention and a distance transform based loss function in a novel multitask learning formulation to improve localization and reconstruction compared to single-task optimized methods. Given the scarcity of real-world sensor-image pairs required for training supervised deep learning models, we leverage physics-based simulation to generate synthetic datasets and use a transfer learning module to align the sensor domain distribution between in silico and real-world data, while taking advantage of cross-domain learning. Applying our method, we find that we can reconstruct and localize lesions faithfully while allowing real-time reconstruction. We also demonstrate that the present algorithm can reconstruct multiple cancer lesions. The results demonstrate that multitask learning provides sharper and more accurate reconstruction.","PeriodicalId":13418,"journal":{"name":"IEEE Transactions on Medical Imaging","volume":"41 1","pages":"515-530"},"PeriodicalIF":10.6,"publicationDate":"2020-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41393299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Deng-Ping Fan, Tao Zhou, Ge-Peng Ji, Yi Zhou, Geng Chen, H. Fu, Jianbing Shen, Ling Shao
{"title":"Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images","authors":"Deng-Ping Fan, Tao Zhou, Ge-Peng Ji, Yi Zhou, Geng Chen, H. Fu, Jianbing Shen, Ling Shao","doi":"10.1101/2020.04.22.20074948","DOIUrl":"https://doi.org/10.1101/2020.04.22.20074948","url":null,"abstract":"Coronavirus Disease 2019 (COVID-19) spread globally in early 2020, causing the world to face an existential health crisis. Automated detection of lung infections from computed tomography (CT) images offers a great potential to augment the traditional healthcare strategy for tackling COVID-19. However, segmenting infected regions from CT slices faces several challenges, including high variation in infection characteristics, and low intensity contrast between infections and normal tissues. Further, collecting a large amount of data is impractical within a short time period, inhibiting the training of a deep model. To address these challenges, a novel COVID-19 Lung Infection Segmentation Deep Network (Inf-Net) is proposed to automatically identify infected regions from chest CT slices. In our Inf-Net, a parallel partial decoder is used to aggregate the high-level features and generate a global map. Then, the implicit reverse attention and explicit edge-attention are utilized to model the boundaries and enhance the representations. Moreover, to alleviate the shortage of labeled data, we present a semi-supervised segmentation framework based on a randomly selected propagation strategy, which only requires a few labeled images and leverages primarily unlabeled data. Our semi-supervised framework can improve the learning ability and achieve a higher performance. Extensive experiments on our COVID-SemiSeg and real CT volumes demonstrate that the proposed Inf-Net outperforms most cutting-edge segmentation models and advances the state-of-the-art performance.","PeriodicalId":13418,"journal":{"name":"IEEE Transactions on Medical Imaging","volume":"39 1","pages":"2626-2637"},"PeriodicalIF":10.6,"publicationDate":"2020-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46450569","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ilya A Verzhbinsky, Luigi E Perotti, Kevin Moulin, Tyler E Cork, Michael Loecher, Daniel B Ennis
{"title":"Estimating Aggregate Cardiomyocyte Strain Using In Vivo Diffusion and Displacement Encoded MRI.","authors":"Ilya A Verzhbinsky, Luigi E Perotti, Kevin Moulin, Tyler E Cork, Michael Loecher, Daniel B Ennis","doi":"10.1109/TMI.2019.2933813","DOIUrl":"10.1109/TMI.2019.2933813","url":null,"abstract":"<p><p>Changes in left ventricular (LV) aggregate cardiomyocyte orientation and deformation underlie cardiac function and dysfunction. As such, in vivo aggregate cardiomyocyte \"myofiber\" strain ( [Formula: see text]) has mechanistic significance, but currently there exists no established technique to measure in vivo [Formula: see text]. The objective of this work is to describe and validate a pipeline to compute in vivo [Formula: see text] from magnetic resonance imaging (MRI) data. Our pipeline integrates LV motion from multi-slice Displacement ENcoding with Stimulated Echoes (DENSE) MRI with in vivo LV microstructure from cardiac Diffusion Tensor Imaging (cDTI) data. The proposed pipeline is validated using an analytical deforming heart-like phantom. The phantom is used to evaluate 3D cardiac strains computed from a widely available, open-source DENSE Image Analysis Tool. Phantom evaluation showed that a DENSE MRI signal-to-noise ratio (SNR) ≥20 is required to compute [Formula: see text] with near-zero median strain bias and within a strain tolerance of 0.06. Circumferential and longitudinal strains are also accurately measured under the same SNR requirements, however, radial strain exhibits a median epicardial bias of -0.10 even in noise-free DENSE data. The validated framework is applied to experimental DENSE MRI and cDTI data acquired in eight ( N=8 ) healthy swine. The experimental study demonstrated that [Formula: see text] has decreased transmural variability compared to radial and circumferential strains. The spatial uniformity and mechanistic significance of in vivo [Formula: see text] make it a compelling candidate for characterization and early detection of cardiac dysfunction.</p>","PeriodicalId":13418,"journal":{"name":"IEEE Transactions on Medical Imaging","volume":"39 1","pages":"656-667"},"PeriodicalIF":10.6,"publicationDate":"2020-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7325525/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44411601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Identifying Autism Spectrum Disorder With Multi-Site fMRI via Low-Rank Domain Adaptation.","authors":"Mingliang Wang, Daoqiang Zhang, Jiashuang Huang, Pew-Thian Yap, Dinggang Shen, Mingxia Liu","doi":"10.1109/TMI.2019.2933160","DOIUrl":"10.1109/TMI.2019.2933160","url":null,"abstract":"Autism spectrum disorder (ASD) is a neurodevelopmental disorder that is characterized by a wide range of symptoms. Identifying biomarkers for accurate diagnosis is crucial for early intervention of ASD. While multi-site data increase sample size and statistical power, they suffer from inter-site heterogeneity. To address this issue, we propose a multi-site adaption framework via low-rank representation decomposition (maLRR) for ASD identification based on functional MRI (fMRI). The main idea is to determine a common low-rank representation for data from the multiple sites, aiming to reduce differences in data distributions. Treating one site as a target domain and the remaining sites as source domains, data from these domains are transformed (i.e., adapted) to a common space using low-rank representation. To reduce data heterogeneity between the target and source domains, data from the source domains are linearly represented in the common space by those from the target domain. We evaluated the proposed method on both synthetic and real multi-site fMRI data for ASD identification. The results suggest that our method yields superior performance over several state-of-the-art domain adaptation methods.","PeriodicalId":13418,"journal":{"name":"IEEE Transactions on Medical Imaging","volume":"39 1","pages":"644-655"},"PeriodicalIF":10.6,"publicationDate":"2020-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TMI.2019.2933160","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47688972","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
K. Mechlem, T. Sellerer, M. Viermetz, J. Herzen, F. Pfeiffer
{"title":"Spectral Differential Phase Contrast X-Ray Radiography","authors":"K. Mechlem, T. Sellerer, M. Viermetz, J. Herzen, F. Pfeiffer","doi":"10.1109/TMI.2019.2932450","DOIUrl":"https://doi.org/10.1109/TMI.2019.2932450","url":null,"abstract":"We investigate the combination of two emerging X-ray imaging technologies, namely spectral imaging and differential phase contrast imaging. By acquiring spatially and temporally registered images with several different X-ray spectra, spectral imaging can exploit differences in the energy-dependent attenuation to generate material selective images. Differential phase contrast imaging uses an entirely different contrast generation mechanism: The phase shift that an X-ray wave exhibits when traversing an object. As both methods can determine the (projected) electron density, we propose a novel material decomposition algorithm that uses the spectral and the phase contrast information simultaneously. Numerical experiments show that the combination of these two imaging techniques benefits from the strengths of the individual methods while the weaknesses are mitigated: Quantitatively accurate basis material images are obtained and the noise level is strongly reduced, compared to conventional spectral X-ray imaging.","PeriodicalId":13418,"journal":{"name":"IEEE Transactions on Medical Imaging","volume":"39 1","pages":"578-587"},"PeriodicalIF":10.6,"publicationDate":"2020-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TMI.2019.2932450","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43044033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Coincidence Counters for Charge Sharing Compensation in Spectroscopic Photon Counting Detectors","authors":"S. Hsieh","doi":"10.1109/TMI.2019.2933986","DOIUrl":"https://doi.org/10.1109/TMI.2019.2933986","url":null,"abstract":"The performance of X-ray photon counting detectors (PCDs), especially on spectral tasks, is compromised by charge sharing. Existing mechanisms to compensate for charge sharing, such as charge summing circuitry or larger pixel sizes, increase and aggravate pileup effects. We propose a new mechanism, the coincidence counting bin (CCB), which does not increase pileup and which has implementation similarities to existing energy bins. The CCB is triggered by coincident events in adjacent pixels and provides an estimate of the double counts arising from charge sharing. Unlike charge summing, the CCB does not directly restore corrupted events. Nonetheless, knowledge of the number of coincident counts can be used by the estimator to reduce noise. We simulated a PCD with and without the CCB using Monte Carlo simulations, modeling PCD pixels as instantaneous charge collectors and X-ray energy deposition as producing a Gaussian charge cloud with 75 micron FWHM, independent of energy. With typical operating conditions and at low flux (120 kVp, incident count rate 1% of characteristic count rate, 30 cm object thickness, five energy bins, pixel pitch of 300 microns), the CCB improved dose efficiency of iodine and water basis material decomposition by 70% and 50%, respectively. An improvement of 20% was also seen in an iodine CNR task. These improvements are attenuated as incident flux increases and show moderate dependence on filtration and pixel size. At high flux, the CCB does not provide useful information and is discarded by the estimator. The CCB may be an effective and practical mechanism for charge sharing compensation in PCDs.","PeriodicalId":13418,"journal":{"name":"IEEE Transactions on Medical Imaging","volume":"39 1","pages":"678-687"},"PeriodicalIF":10.6,"publicationDate":"2020-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TMI.2019.2933986","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41743399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
X. Tao, Hua Zhang, Yongbo Wang, G. Yan, D. Zeng, Wufan Chen, Jianhua Ma
{"title":"VVBP-Tensor in the FBP Algorithm: Its Properties and Application in Low-Dose CT Reconstruction","authors":"X. Tao, Hua Zhang, Yongbo Wang, G. Yan, D. Zeng, Wufan Chen, Jianhua Ma","doi":"10.1109/TMI.2019.2935187","DOIUrl":"https://doi.org/10.1109/TMI.2019.2935187","url":null,"abstract":"For decades, commercial X-ray computed tomography (CT) scanners have been using the filtered backprojection (FBP) algorithm for image reconstruction. However, the desire for lower radiation doses has pushed the FBP algorithm to its limit. Previous studies have made significant efforts to improve the results of FBP through preprocessing the sinogram, modifying the ramp filter, or postprocessing the reconstructed images. In this paper, we focus on analyzing and processing the stacked view-by-view backprojections (named VVBP-Tensor) in the FBP algorithm. A key challenge for our analysis lies in the radial structures in each backprojection slice. To overcome this difficulty, a sorting operation was introduced to the VVBP-Tensor in its ${z}$ direction (the direction of the projection views). The results show that, after sorting, the tensor contains structures that are similar to those of the object, and structures in different slices of the tensor are correlated. We then analyzed the properties of the VVBP-Tensor, including structural self-similarity, tensor sparsity, and noise statistics. Considering these properties, we have developed an algorithm using the tensor singular value decomposition (named VVBP-tSVD) to denoise the VVBP-Tensor for low-mAs CT imaging. Experiments were conducted using a physical phantom and clinical patient data with different mAs levels. The results demonstrate that the VVBP-tSVD is superior to all competing methods under different reconstruction schemes, including sinogram preprocessing, image postprocessing, and iterative reconstruction. We conclude that the VVBP-Tensor is a suitable processing target for improving the quality of FBP reconstruction, and the proposed VVBP-tSVD is an effective algorithm for noise reduction in low-mAs CT imaging. This preliminary work might provide a heuristic perspective for reviewing and rethinking the FBP algorithm.","PeriodicalId":13418,"journal":{"name":"IEEE Transactions on Medical Imaging","volume":"39 1","pages":"764-776"},"PeriodicalIF":10.6,"publicationDate":"2020-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TMI.2019.2935187","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42269393","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}