Multiframe super resolution with JPEG2000 compressed images

Abstract

Historically, Joint Photographic Experts Group 2000 (JPEG2000) image compression and multiframe Super Resolution (SR) image processing techniques have evolved separately. We focus on the adaptive Wiener filter (AWF) method of SR and study its performance as JPEG2000 is incorporated in three different ways. In particular, we perform compression prior to SR using independent and difference frame methods. We also consider performing compression after SR. We find that the effects of compression can be reduced by decreasing the signal-to-noise ratio (SNR) in the correlation model for the AWF SR method, providing a novel approach to treat the compression artifacts. This SNR modification can be done globally or locally. The experimental results include the use of simulated imagery for quantitative analysis. We also include real video results for subjective analysis.