On the Ethnic Classification of Pakistani Face using Deep Learning

Abstract

Demographic-based identification plays an active role in the field of face identification. Over the past decade, machine learning algorithms have been used to investigate challenges surrouding ethnic classification for specific populations, such as African, Asian and Caucasian people. Ethnic classification for individuals of South Asian, Pakistani heritage, however, remains to be addressed. The present paper addresses a two-category (Pakistani Vs Non-Pakistani) classification task from a novel, purpose-built dataset. To the best of our knowledge, this work is the first to report a machine learning ethnic classification task with South Asian (Pakistani) faces. We conduted a series of experiments using deep learning algorithms (ResNet-50, ResNet-101 and ResNet-152) for feature extraction and a linear support vector machine (SVM) for classification. The experimental results demonstrate ResNet-101 achieves the highest performance accuracy of 99.2% for full-face ethnicity classification, followed closely by 91.7% and 95.7% for the nose and mouth respectively.