Signature Verification Based on Deep Learning

Abstract

: Signature verification is considered one of the main features in determining the person identity. Our proposed framework emphasizes the potential of Deep Learning Models (DLMs) in revolutionizing signature verification techniques and underscores the need for continuous exploration and advancement in the realm of automated signature authentication. Therefore, five pre-trained DLMs, ResNet50, DenseNet121, MobileNetV3, InceptionV3, and VGG16, based on four different datasets, CEDAR, BH-Sig260 Bengali, BHSig260 Hindi, and ICDAR 2011(Dutch),are introduced in this paper to verify the person identity. Furthermore, data augmentation techniques are applied to overcome dataset limitations and increase the framework's performance. Additionally, transfer learning and fine-tuning techniques are performed to reduce computational time and memory usage. It is observed that the InceptionV3 DLM based on the ICDAR 2011 (Dutch) achieved the best performance of 100% accuracy, 100% AUC and 100% sensitivity. While, CEDAR Dataset achieves performance with an accuracy of 99.76%, an AUC of 99.94%, sensitivity of 99.76%, precision of 99.76%, an F1-score of 99.71%, score, and a computational time of 13.627s.