{"title":"The effects of data preprocessing on probability of default model fairness","authors":"Di Wu","doi":"arxiv-2408.15452","DOIUrl":null,"url":null,"abstract":"In the context of financial credit risk evaluation, the fairness of machine\nlearning models has become a critical concern, especially given the potential\nfor biased predictions that disproportionately affect certain demographic\ngroups. This study investigates the impact of data preprocessing, with a\nspecific focus on Truncated Singular Value Decomposition (SVD), on the fairness\nand performance of probability of default models. Using a comprehensive dataset\nsourced from Kaggle, various preprocessing techniques, including SVD, were\napplied to assess their effect on model accuracy, discriminatory power, and\nfairness.","PeriodicalId":501293,"journal":{"name":"arXiv - ECON - Econometrics","volume":"1 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - ECON - Econometrics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.15452","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In the context of financial credit risk evaluation, the fairness of machine
learning models has become a critical concern, especially given the potential
for biased predictions that disproportionately affect certain demographic
groups. This study investigates the impact of data preprocessing, with a
specific focus on Truncated Singular Value Decomposition (SVD), on the fairness
and performance of probability of default models. Using a comprehensive dataset
sourced from Kaggle, various preprocessing techniques, including SVD, were
applied to assess their effect on model accuracy, discriminatory power, and
fairness.