考虑极端数据不平衡和偏态的深度神经网络叶绿素a浓度建模

Jangho Choi, Jiyong Kim, Jong-Gwon Won, Ok-Gee Min
{"title":"考虑极端数据不平衡和偏态的深度神经网络叶绿素a浓度建模","authors":"Jangho Choi, Jiyong Kim, Jong-Gwon Won, Ok-Gee Min","doi":"10.23919/ICACT.2019.8702027","DOIUrl":null,"url":null,"abstract":"Algal bloom has been a serious problem, as some of algae such as cyanobacteria produce toxic wastes. Chlorophyll-a has been one of the primary indicator of algal bloom; however, it is difficult to model to forecast due to scarceness of the events. Since canonical machine learning algorithms assume balanced datasets, data imbalance of the Chlorophyll-a concentration must be visited for accurate prediction. In this paper, we present a convolutional neural network model to predict Chlorophyll-a concentration, handling its data imbalance and skewness. The experiment results show that proper data transformation and oversampling can improve prediction accuracy, especially in rare-event regions.","PeriodicalId":226261,"journal":{"name":"2019 21st International Conference on Advanced Communication Technology (ICACT)","volume":"2011 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"23","resultStr":"{\"title\":\"Modelling Chlorophyll-a Concentration using Deep Neural Networks considering Extreme Data Imbalance and Skewness\",\"authors\":\"Jangho Choi, Jiyong Kim, Jong-Gwon Won, Ok-Gee Min\",\"doi\":\"10.23919/ICACT.2019.8702027\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Algal bloom has been a serious problem, as some of algae such as cyanobacteria produce toxic wastes. Chlorophyll-a has been one of the primary indicator of algal bloom; however, it is difficult to model to forecast due to scarceness of the events. Since canonical machine learning algorithms assume balanced datasets, data imbalance of the Chlorophyll-a concentration must be visited for accurate prediction. In this paper, we present a convolutional neural network model to predict Chlorophyll-a concentration, handling its data imbalance and skewness. The experiment results show that proper data transformation and oversampling can improve prediction accuracy, especially in rare-event regions.\",\"PeriodicalId\":226261,\"journal\":{\"name\":\"2019 21st International Conference on Advanced Communication Technology (ICACT)\",\"volume\":\"2011 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"23\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 21st International Conference on Advanced Communication Technology (ICACT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.23919/ICACT.2019.8702027\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 21st International Conference on Advanced Communication Technology (ICACT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/ICACT.2019.8702027","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 23

摘要

藻华一直是一个严重的问题,因为一些藻类,如蓝藻会产生有毒废物。叶绿素-a一直是藻华的主要指标之一;然而,由于事件的稀缺性,很难建立模型进行预测。由于规范的机器学习算法假设平衡的数据集,因此必须访问叶绿素-a浓度的数据不平衡以进行准确的预测。本文提出了一种卷积神经网络模型来预测叶绿素-a浓度,并对其数据的不平衡和偏态进行了处理。实验结果表明,适当的数据转换和过采样可以提高预测精度,特别是在罕见事件区域。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Modelling Chlorophyll-a Concentration using Deep Neural Networks considering Extreme Data Imbalance and Skewness
Algal bloom has been a serious problem, as some of algae such as cyanobacteria produce toxic wastes. Chlorophyll-a has been one of the primary indicator of algal bloom; however, it is difficult to model to forecast due to scarceness of the events. Since canonical machine learning algorithms assume balanced datasets, data imbalance of the Chlorophyll-a concentration must be visited for accurate prediction. In this paper, we present a convolutional neural network model to predict Chlorophyll-a concentration, handling its data imbalance and skewness. The experiment results show that proper data transformation and oversampling can improve prediction accuracy, especially in rare-event regions.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信