增强医学数据学习的预处理流程

Sebastian Muresan, Ioana Faloba, C. Lemnaru, R. Potolea
{"title":"增强医学数据学习的预处理流程","authors":"Sebastian Muresan, Ioana Faloba, C. Lemnaru, R. Potolea","doi":"10.1109/ICCP.2015.7312601","DOIUrl":null,"url":null,"abstract":"Data enhancement is an essential operation when dealing with incomplete and imbalanced data sets. Further classification on such data might prove to be a difficult task. This paper tackles such issues in a specific learning context - medical treatment prediction for breast cancer. We process the problem specific medical data starting from the preparation phase. We apply several data cleaning and selection steps. The resulting data proved to possess an insufficient quality for the learning process. Therefore, we propose and apply several data enhancement steps, such as imputation for handling missing values, feature selection for reducing the dimensionality of the attribute space and a modified version of the SMOTE oversampling algorithm to tackle data imbalance in conjunction with incompleteness. Evaluations of the entire pre-processing flow, performed on the available medical data, have indicated significant improvements in classification performance.","PeriodicalId":158453,"journal":{"name":"2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"Pre-processing flow for enhancing learning from medical data\",\"authors\":\"Sebastian Muresan, Ioana Faloba, C. Lemnaru, R. Potolea\",\"doi\":\"10.1109/ICCP.2015.7312601\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Data enhancement is an essential operation when dealing with incomplete and imbalanced data sets. Further classification on such data might prove to be a difficult task. This paper tackles such issues in a specific learning context - medical treatment prediction for breast cancer. We process the problem specific medical data starting from the preparation phase. We apply several data cleaning and selection steps. The resulting data proved to possess an insufficient quality for the learning process. Therefore, we propose and apply several data enhancement steps, such as imputation for handling missing values, feature selection for reducing the dimensionality of the attribute space and a modified version of the SMOTE oversampling algorithm to tackle data imbalance in conjunction with incompleteness. Evaluations of the entire pre-processing flow, performed on the available medical data, have indicated significant improvements in classification performance.\",\"PeriodicalId\":158453,\"journal\":{\"name\":\"2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP)\",\"volume\":\"19 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-11-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCP.2015.7312601\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCP.2015.7312601","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

摘要

数据增强是处理不完整和不平衡数据集时必不可少的操作。进一步对这些数据进行分类可能是一项艰巨的任务。本文在一个特定的学习环境中解决了这些问题——乳腺癌的药物治疗预测。我们从准备阶段开始处理特定问题的医疗数据。我们应用了几个数据清理和选择步骤。结果数据被证明对学习过程具有不足的质量。因此,我们提出并应用了几个数据增强步骤,例如处理缺失值的imputation,降低属性空间维数的特征选择以及改进版本的SMOTE过采样算法来处理数据不平衡和不完整性。对现有医疗数据进行的整个预处理流程的评估表明,分类性能有了显著改善。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Pre-processing flow for enhancing learning from medical data
Data enhancement is an essential operation when dealing with incomplete and imbalanced data sets. Further classification on such data might prove to be a difficult task. This paper tackles such issues in a specific learning context - medical treatment prediction for breast cancer. We process the problem specific medical data starting from the preparation phase. We apply several data cleaning and selection steps. The resulting data proved to possess an insufficient quality for the learning process. Therefore, we propose and apply several data enhancement steps, such as imputation for handling missing values, feature selection for reducing the dimensionality of the attribute space and a modified version of the SMOTE oversampling algorithm to tackle data imbalance in conjunction with incompleteness. Evaluations of the entire pre-processing flow, performed on the available medical data, have indicated significant improvements in classification performance.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信