Jangho Choi, Jiyong Kim, Jong-Gwon Won, Ok-Gee Min
{"title":"考虑极端数据不平衡和偏态的深度神经网络叶绿素a浓度建模","authors":"Jangho Choi, Jiyong Kim, Jong-Gwon Won, Ok-Gee Min","doi":"10.23919/ICACT.2019.8702027","DOIUrl":null,"url":null,"abstract":"Algal bloom has been a serious problem, as some of algae such as cyanobacteria produce toxic wastes. Chlorophyll-a has been one of the primary indicator of algal bloom; however, it is difficult to model to forecast due to scarceness of the events. Since canonical machine learning algorithms assume balanced datasets, data imbalance of the Chlorophyll-a concentration must be visited for accurate prediction. In this paper, we present a convolutional neural network model to predict Chlorophyll-a concentration, handling its data imbalance and skewness. The experiment results show that proper data transformation and oversampling can improve prediction accuracy, especially in rare-event regions.","PeriodicalId":226261,"journal":{"name":"2019 21st International Conference on Advanced Communication Technology (ICACT)","volume":"2011 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"23","resultStr":"{\"title\":\"Modelling Chlorophyll-a Concentration using Deep Neural Networks considering Extreme Data Imbalance and Skewness\",\"authors\":\"Jangho Choi, Jiyong Kim, Jong-Gwon Won, Ok-Gee Min\",\"doi\":\"10.23919/ICACT.2019.8702027\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Algal bloom has been a serious problem, as some of algae such as cyanobacteria produce toxic wastes. Chlorophyll-a has been one of the primary indicator of algal bloom; however, it is difficult to model to forecast due to scarceness of the events. Since canonical machine learning algorithms assume balanced datasets, data imbalance of the Chlorophyll-a concentration must be visited for accurate prediction. In this paper, we present a convolutional neural network model to predict Chlorophyll-a concentration, handling its data imbalance and skewness. The experiment results show that proper data transformation and oversampling can improve prediction accuracy, especially in rare-event regions.\",\"PeriodicalId\":226261,\"journal\":{\"name\":\"2019 21st International Conference on Advanced Communication Technology (ICACT)\",\"volume\":\"2011 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"23\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 21st International Conference on Advanced Communication Technology (ICACT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.23919/ICACT.2019.8702027\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 21st International Conference on Advanced Communication Technology (ICACT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/ICACT.2019.8702027","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Modelling Chlorophyll-a Concentration using Deep Neural Networks considering Extreme Data Imbalance and Skewness
Algal bloom has been a serious problem, as some of algae such as cyanobacteria produce toxic wastes. Chlorophyll-a has been one of the primary indicator of algal bloom; however, it is difficult to model to forecast due to scarceness of the events. Since canonical machine learning algorithms assume balanced datasets, data imbalance of the Chlorophyll-a concentration must be visited for accurate prediction. In this paper, we present a convolutional neural network model to predict Chlorophyll-a concentration, handling its data imbalance and skewness. The experiment results show that proper data transformation and oversampling can improve prediction accuracy, especially in rare-event regions.