Feasibility of Machine Learning Support for Holistic Review of Undergraduate Applications

Abstract

College admissions processes have traditionally relied on academic characteristics like GPA and standardized testing, as well as supplementary application materials. In California, the introduction of Proposition 209 in 1996 prohibited the consideration of gender and ethnicity. In an attempt to increase diversity, many universities adopted holistic review to fairly evaluate and consider applicants’ abilities inside and outside the classroom. However, this increases subjective assessment which could have implications for human bias. As such, Machine Learning (ML) should be explored as a means of assistance while also reducing potential bias.Minimal data regarding ML in undergraduate holistic review has been evaluated. In this paper, we discuss performances of supervised classifiers that could provide verification of the scores that application reviewers assign. We utilize a dataset of applicants to the Computer Science department at the University of California, Irvine to train our models. Collected data includes demographics, academic history, high school information, and essay responses. The best-performing classifiers trained on this data were Logistic Regression and Gradient Boost. Both achieved 0.871 AUROC scores, and Logistic Regression obtained the highest accuracy of 0.783. With feature coefficient analysis, we observed the effects of academic achievement, extracurricular involvement and writing complexity on the model’s predictions.