Semi-Supervised Tumor Response Grade Classification from Histology Images of Colorectal Liver Metastases

Abstract

Colorectal liver metastases (CLM) develop in almost half of patients with colon cancer. Response to systemic chemotherapy is the main determinant of patient survival. Due to the importance of assessing treatment response of CLM to chemotherapy for the patient prognosis, there is a need to classify tumor response grade (TRG) on histopathology slides (HPS). However, annotating HPS for training neural networks is a time-consuming task. In this work, we present an end-to-end approach for tissue classification of CLM slides leading to TRG prediction. A weakly-supervised model is first trained to perform tissue classification from sparse annotations, generating segmentation maps. Then, using features extracted for these maps, a secondary model is trained to perform the TRG classification. We demonstrate the feasibility of the proposed approach on a clinical dataset of 1450 HPS from 232 CLM patients by comparing our semi-supervised Mean Teacher approach with other supervised and semi-supervised methods. The proposed pipeline outperforms other models, achieving a classification accuracy of 94.4%. Based on the generated classification maps, the model is able to stratify patients into two TRG classes (1-2 vs 3-5) with an accuracy of 86.2%.