A Variational Multi-Scale Error Compensation Network for Single-Pixel Imaging

Abstract

Single-pixel imaging is an advanced computational imaging technique based on compressive sensing that offers higher signal-to-noise ratio and broader application scope compared to traditional imaging techniques. However, conventional reconstruction algorithms suffer from issues such as long processing time and low reconstruction accuracy during the sampling and reconstruction processes. Deep learning-based compressed reconstruction networks can circumvent the complex iterative computations of traditional algorithms and achieve fast, high-quality reconstruction. In this paper, we propose a Variational Multi-Scale Error Compensation Network (VMSE) based on variational autoencoders. VMSE designs an error compensation network to enhance the feature representation capability of the sampling reconstruction network. We employ multiple latent variables to generate error features at different scales in the intermediate layers of the error compensation network, compensating the reconstructed image. Additionally, we design a module that simultaneously learns in the spatial and frequency domains, which is used for upsampling and complementing the missing high-frequency information in the frequency domain. On the MNIST dataset, when the sampling rate is 0.025, VMSE achieved higher Peak Signal-to-Noise Ratio(PSNR) and Structural Similarity Index(SSIM) scores, especially with an SSIM score of 0.963, significantly surpassing Reconnet and DR2Net's scores of 0.930 and 0.920, respectively. This was further corroborated by practical experiments, where at low sampling rates, VMSE could reconstruct outlines more clearly compared to TVAL3.