Adaptive image selection method for focus stacking based on a low-level vision task-driven network and liquid lens.

Abstract

An all-in-focus ( AIF) image has been employed broadly in various fields such as microscopy imaging, medical imaging, and high-level vision tasks. Focus stacking is a key technology for merging AIF images. Considerable efforts have been made to reconstruct AIF images accurately. However, little attention has been paid to capturing focal stack images effectively. This paper proposes an adaptive image selection method for capturing focal stack images based on a low-level vision task-driven network and liquid lens. The proposed method can maintain the integral quality using the minimum number of focal stack images. The low-level vision task-driven network termed FocalAIF-Net consists of a two-branch FocalNet and an auxiliary low-level vision task AIFNet. The FocalNet can estimate the blur map and the focal map from a defocused image with its depth map. Various quantitative and qualitative evaluation results on three benchmark datasets show that our FocalAIF-Net network achieves acceptable generalization performance. Additionally, we employ a liquid lens to zoom swiftly under the guidance of the proposed decision algorithm during real-world experiments to verify the effectiveness of the proposed method. The results show that the focal stack acquired by our method has a strong capacity to merge a more accurate AIF image and consume less running time compared to that achieved with a common average interval by mechanical movement.