Sebastian Muresan, Ioana Faloba, C. Lemnaru, R. Potolea
{"title":"增强医学数据学习的预处理流程","authors":"Sebastian Muresan, Ioana Faloba, C. Lemnaru, R. Potolea","doi":"10.1109/ICCP.2015.7312601","DOIUrl":null,"url":null,"abstract":"Data enhancement is an essential operation when dealing with incomplete and imbalanced data sets. Further classification on such data might prove to be a difficult task. This paper tackles such issues in a specific learning context - medical treatment prediction for breast cancer. We process the problem specific medical data starting from the preparation phase. We apply several data cleaning and selection steps. The resulting data proved to possess an insufficient quality for the learning process. Therefore, we propose and apply several data enhancement steps, such as imputation for handling missing values, feature selection for reducing the dimensionality of the attribute space and a modified version of the SMOTE oversampling algorithm to tackle data imbalance in conjunction with incompleteness. Evaluations of the entire pre-processing flow, performed on the available medical data, have indicated significant improvements in classification performance.","PeriodicalId":158453,"journal":{"name":"2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Pre-processing flow for enhancing learning from medical data\",\"authors\":\"Sebastian Muresan, Ioana Faloba, C. Lemnaru, R. Potolea\",\"doi\":\"10.1109/ICCP.2015.7312601\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Data enhancement is an essential operation when dealing with incomplete and imbalanced data sets. Further classification on such data might prove to be a difficult task. This paper tackles such issues in a specific learning context - medical treatment prediction for breast cancer. We process the problem specific medical data starting from the preparation phase. We apply several data cleaning and selection steps. The resulting data proved to possess an insufficient quality for the learning process. Therefore, we propose and apply several data enhancement steps, such as imputation for handling missing values, feature selection for reducing the dimensionality of the attribute space and a modified version of the SMOTE oversampling algorithm to tackle data imbalance in conjunction with incompleteness. Evaluations of the entire pre-processing flow, performed on the available medical data, have indicated significant improvements in classification performance.\",\"PeriodicalId\":158453,\"journal\":{\"name\":\"2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP)\",\"volume\":\"19 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-11-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCP.2015.7312601\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCP.2015.7312601","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Pre-processing flow for enhancing learning from medical data
Data enhancement is an essential operation when dealing with incomplete and imbalanced data sets. Further classification on such data might prove to be a difficult task. This paper tackles such issues in a specific learning context - medical treatment prediction for breast cancer. We process the problem specific medical data starting from the preparation phase. We apply several data cleaning and selection steps. The resulting data proved to possess an insufficient quality for the learning process. Therefore, we propose and apply several data enhancement steps, such as imputation for handling missing values, feature selection for reducing the dimensionality of the attribute space and a modified version of the SMOTE oversampling algorithm to tackle data imbalance in conjunction with incompleteness. Evaluations of the entire pre-processing flow, performed on the available medical data, have indicated significant improvements in classification performance.