去噪能否提高学习模型的预测精度?小波分解法案例

C. Tamilselvi, M. Yeasin, R. Paul, Amrit Kumar Paul
{"title":"去噪能否提高学习模型的预测精度?小波分解法案例","authors":"C. Tamilselvi, M. Yeasin, R. Paul, Amrit Kumar Paul","doi":"10.3390/forecast6010005","DOIUrl":null,"url":null,"abstract":"Denoising is an integral part of the data pre-processing pipeline that often works in conjunction with model development for enhancing the quality of data, improving model accuracy, preventing overfitting, and contributing to the overall robustness of predictive models. Algorithms based on a combination of wavelet with deep learning, machine learning, and stochastic model have been proposed. The denoised series are fitted with various benchmark models, including long short-term memory (LSTM), support vector regression (SVR), artificial neural network (ANN), and autoregressive integrated moving average (ARIMA) models. The effectiveness of a wavelet-based denoising approach was investigated on monthly wholesale price data for three major spices (turmeric, coriander, and cumin) for various markets in India. The predictive performance of these models is assessed using root mean square error (RMSE), mean absolute percentage error (MAPE), and mean absolute error (MAE). The wavelet LSTM model with Haar filter at level 6 emerged as a robust choice for accurate price predictions across all spices. It was found that the wavelet LSTM model had a significant gain in accuracy than the LSTM model by more than 30% across all accuracy metrics. The results clearly highlighted the efficacy of a wavelet-based denoising approach in enhancing the accuracy of price forecasting.","PeriodicalId":508737,"journal":{"name":"Forecasting","volume":" 13","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Can Denoising Enhance Prediction Accuracy of Learning Models? A Case of Wavelet Decomposition Approach\",\"authors\":\"C. Tamilselvi, M. Yeasin, R. Paul, Amrit Kumar Paul\",\"doi\":\"10.3390/forecast6010005\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Denoising is an integral part of the data pre-processing pipeline that often works in conjunction with model development for enhancing the quality of data, improving model accuracy, preventing overfitting, and contributing to the overall robustness of predictive models. Algorithms based on a combination of wavelet with deep learning, machine learning, and stochastic model have been proposed. The denoised series are fitted with various benchmark models, including long short-term memory (LSTM), support vector regression (SVR), artificial neural network (ANN), and autoregressive integrated moving average (ARIMA) models. The effectiveness of a wavelet-based denoising approach was investigated on monthly wholesale price data for three major spices (turmeric, coriander, and cumin) for various markets in India. The predictive performance of these models is assessed using root mean square error (RMSE), mean absolute percentage error (MAPE), and mean absolute error (MAE). The wavelet LSTM model with Haar filter at level 6 emerged as a robust choice for accurate price predictions across all spices. It was found that the wavelet LSTM model had a significant gain in accuracy than the LSTM model by more than 30% across all accuracy metrics. The results clearly highlighted the efficacy of a wavelet-based denoising approach in enhancing the accuracy of price forecasting.\",\"PeriodicalId\":508737,\"journal\":{\"name\":\"Forecasting\",\"volume\":\" 13\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-01-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Forecasting\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3390/forecast6010005\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Forecasting","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/forecast6010005","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

去噪是数据预处理管道中不可或缺的一部分,通常与模型开发相结合,以提高数据质量、改善模型准确性、防止过拟合,并增强预测模型的整体稳健性。有人提出了基于小波与深度学习、机器学习和随机模型相结合的算法。用各种基准模型对去噪序列进行拟合,包括长短期记忆(LSTM)、支持向量回归(SVR)、人工神经网络(ANN)和自回归综合移动平均(ARIMA)模型。对印度不同市场三种主要香料(姜黄、芫荽和小茴香)的月度批发价格数据,研究了基于小波的去噪方法的有效性。使用均方根误差 (RMSE)、平均绝对百分比误差 (MAPE) 和平均绝对误差 (MAE) 评估了这些模型的预测性能。采用第 6 级 Haar 滤波器的小波 LSTM 模型是准确预测所有香料价格的稳健选择。研究发现,在所有准确度指标上,小波 LSTM 模型的准确度都比 LSTM 模型高出 30% 以上。这些结果清楚地表明了基于小波的去噪方法在提高价格预测准确性方面的功效。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Can Denoising Enhance Prediction Accuracy of Learning Models? A Case of Wavelet Decomposition Approach
Denoising is an integral part of the data pre-processing pipeline that often works in conjunction with model development for enhancing the quality of data, improving model accuracy, preventing overfitting, and contributing to the overall robustness of predictive models. Algorithms based on a combination of wavelet with deep learning, machine learning, and stochastic model have been proposed. The denoised series are fitted with various benchmark models, including long short-term memory (LSTM), support vector regression (SVR), artificial neural network (ANN), and autoregressive integrated moving average (ARIMA) models. The effectiveness of a wavelet-based denoising approach was investigated on monthly wholesale price data for three major spices (turmeric, coriander, and cumin) for various markets in India. The predictive performance of these models is assessed using root mean square error (RMSE), mean absolute percentage error (MAPE), and mean absolute error (MAE). The wavelet LSTM model with Haar filter at level 6 emerged as a robust choice for accurate price predictions across all spices. It was found that the wavelet LSTM model had a significant gain in accuracy than the LSTM model by more than 30% across all accuracy metrics. The results clearly highlighted the efficacy of a wavelet-based denoising approach in enhancing the accuracy of price forecasting.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
5.80
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信