An EfficientNet-like Feature Extractor and Focal CTC Loss for Image-base Sequence Recognition

Abstract

Image-based sequence recognition is an interesting topic in computer vision, which has various potential applications in real life. This paper proposes a novel convolutional-recurrent neural network (CRNN) for image-based sequence recognition. Particularly, we introduce a new convolutional backbone network for feature extraction based on the EfficientNet architecture and use focal CTC loss to train the network. Our method beats several existing state-of-the-art methods on the ICDAR 2019 Robust Reading Challenge on Scanned Receipts OCR and Information Extraction (SROIE) challenge and the IAM handwriting dataset. The experimental results show that our method yields an F1 score equivalent to the top 2 on the ICDAR 2019 SROIE challenge.