Going Smaller: Attention-based models for automated melanoma diagnosis

Abstract

Computational approaches offer a valuable tool to aid with the early diagnosis of melanoma by increasing both the speed and accuracy of doctors’ decisions. The latest and best-performing approaches often rely on large ensemble models, with the number of trained parameters exceeding 600 million. However, this large parameter count presents considerable challenges in terms of computational demands and practical application. Addressing this gap, our work introduces a suite of attention-based convolutional neural network (CNN) architectures tailored to the nuanced classification of melanoma. These innovative models, founded on the EfficientNet-B3 backbone, are characterized by their significantly reduced size. This study highlights the feasibility of deploying powerful, yet compact, diagnostic models in practical settings, such as smartphone-based dermoscopy, and in doing so revolutionizing point-of-care diagnostics and extending the reach of advanced medical technologies to remote and under-resourced areas. It presents a comparative analysis of these novel models with the top three prize winners of the International Skin Imaging Collaboration (ISIC) 2020 challenge using two independent test sets. The results for our architectures outperformed the second and third-placed winners and achieved comparable results to the first-placed winner. These models demonstrated a delicate balance between efficiency and accuracy, holding their ground against larger models in performance metrics while operating on up to 98% less number of parameters and showcasing their potential for real-time application in resource-limited environments.