停止风速预报中不切实际的数据预处理:防止未来数据泄露的途径与探讨

IF 4.4 2区 工程技术 Q1 ENGINEERING, MULTIDISCIPLINARY
Junheng Pang, Sheng Dong
{"title":"停止风速预报中不切实际的数据预处理:防止未来数据泄露的途径与探讨","authors":"Junheng Pang,&nbsp;Sheng Dong","doi":"10.1016/j.apm.2025.116376","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate wind speed forecasting is crucial for the development of wind energy. Recently, hybrid models integrating artificial intelligence with data preprocessing techniques have shown superior performance, becoming the mainstream approach. However, many current studies misused data preprocessing techniques by decomposing the entire dataset at once, leading to future data leakage and spurious high precision. To prevent further research from falling into this modeling trap and to explore whether data preprocessing techniques can actively contribute to wind speed forecasting in real-world, we propose several practical solutions and rigorously evaluate their effectiveness. More specifically, three sampling strategy-based approaches including rolling decomposition, stepwise decomposition and sliding window decomposition, as well as a decomposition principle-based approach, maximal overlap discrete wavelet transform, are employed to prevent data leakage. The extreme learning machine, support vector regression and long-short memory are employed as basic models and combined with empirical mode decomposition, variational mode decomposition, and discrete wavelet transform to form hybrid models. The realistic forecasting performance of these hybrid models are comprehensively verified and discussed in-depth. The experimental results indicate that (1) The boundary effect is a major hindrance to enhancing forecasting accuracy. (2) Maximal overlap discrete wavelet transform-based models outperformed their corresponding single models in most cases. (3) Wavelet transform-based models are promising and deserve further exploration.</div></div>","PeriodicalId":50980,"journal":{"name":"Applied Mathematical Modelling","volume":"150 ","pages":"Article 116376"},"PeriodicalIF":4.4000,"publicationDate":"2025-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Stop unrealistic data preprocessing in wind speed forecasting: approaches and discussions on preventing future data leakage\",\"authors\":\"Junheng Pang,&nbsp;Sheng Dong\",\"doi\":\"10.1016/j.apm.2025.116376\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Accurate wind speed forecasting is crucial for the development of wind energy. Recently, hybrid models integrating artificial intelligence with data preprocessing techniques have shown superior performance, becoming the mainstream approach. However, many current studies misused data preprocessing techniques by decomposing the entire dataset at once, leading to future data leakage and spurious high precision. To prevent further research from falling into this modeling trap and to explore whether data preprocessing techniques can actively contribute to wind speed forecasting in real-world, we propose several practical solutions and rigorously evaluate their effectiveness. More specifically, three sampling strategy-based approaches including rolling decomposition, stepwise decomposition and sliding window decomposition, as well as a decomposition principle-based approach, maximal overlap discrete wavelet transform, are employed to prevent data leakage. The extreme learning machine, support vector regression and long-short memory are employed as basic models and combined with empirical mode decomposition, variational mode decomposition, and discrete wavelet transform to form hybrid models. The realistic forecasting performance of these hybrid models are comprehensively verified and discussed in-depth. The experimental results indicate that (1) The boundary effect is a major hindrance to enhancing forecasting accuracy. (2) Maximal overlap discrete wavelet transform-based models outperformed their corresponding single models in most cases. (3) Wavelet transform-based models are promising and deserve further exploration.</div></div>\",\"PeriodicalId\":50980,\"journal\":{\"name\":\"Applied Mathematical Modelling\",\"volume\":\"150 \",\"pages\":\"Article 116376\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2025-08-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Mathematical Modelling\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0307904X25004500\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Mathematical Modelling","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0307904X25004500","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

准确的风速预报对风能的开发至关重要。近年来,将人工智能与数据预处理技术相结合的混合模型表现出优异的性能,成为主流方法。然而,目前许多研究滥用数据预处理技术,一次分解整个数据集,导致未来的数据泄漏和虚假的高精度。为了防止进一步的研究陷入这种建模陷阱,并探索数据预处理技术是否能在现实世界中积极促进风速预测,我们提出了几个实用的解决方案,并严格评估了它们的有效性。具体来说,采用基于滚动分解、逐步分解和滑动窗口分解三种采样策略,以及基于分解原理的最大重叠离散小波变换来防止数据泄漏。采用极限学习机、支持向量回归和长短记忆作为基本模型,结合经验模态分解、变分模态分解和离散小波变换形成混合模型。对这些混合模型的实际预测性能进行了全面验证和深入讨论。实验结果表明:(1)边界效应是影响预测精度的主要障碍。(2)基于最大重叠离散小波变换的模型在大多数情况下优于其对应的单一模型。(3)基于小波变换的模型前景广阔,值得进一步探索。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Stop unrealistic data preprocessing in wind speed forecasting: approaches and discussions on preventing future data leakage
Accurate wind speed forecasting is crucial for the development of wind energy. Recently, hybrid models integrating artificial intelligence with data preprocessing techniques have shown superior performance, becoming the mainstream approach. However, many current studies misused data preprocessing techniques by decomposing the entire dataset at once, leading to future data leakage and spurious high precision. To prevent further research from falling into this modeling trap and to explore whether data preprocessing techniques can actively contribute to wind speed forecasting in real-world, we propose several practical solutions and rigorously evaluate their effectiveness. More specifically, three sampling strategy-based approaches including rolling decomposition, stepwise decomposition and sliding window decomposition, as well as a decomposition principle-based approach, maximal overlap discrete wavelet transform, are employed to prevent data leakage. The extreme learning machine, support vector regression and long-short memory are employed as basic models and combined with empirical mode decomposition, variational mode decomposition, and discrete wavelet transform to form hybrid models. The realistic forecasting performance of these hybrid models are comprehensively verified and discussed in-depth. The experimental results indicate that (1) The boundary effect is a major hindrance to enhancing forecasting accuracy. (2) Maximal overlap discrete wavelet transform-based models outperformed their corresponding single models in most cases. (3) Wavelet transform-based models are promising and deserve further exploration.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Applied Mathematical Modelling
Applied Mathematical Modelling 数学-工程:综合
CiteScore
9.80
自引率
8.00%
发文量
508
审稿时长
43 days
期刊介绍: Applied Mathematical Modelling focuses on research related to the mathematical modelling of engineering and environmental processes, manufacturing, and industrial systems. A significant emerging area of research activity involves multiphysics processes, and contributions in this area are particularly encouraged. This influential publication covers a wide spectrum of subjects including heat transfer, fluid mechanics, CFD, and transport phenomena; solid mechanics and mechanics of metals; electromagnets and MHD; reliability modelling and system optimization; finite volume, finite element, and boundary element procedures; modelling of inventory, industrial, manufacturing and logistics systems for viable decision making; civil engineering systems and structures; mineral and energy resources; relevant software engineering issues associated with CAD and CAE; and materials and metallurgical engineering. Applied Mathematical Modelling is primarily interested in papers developing increased insights into real-world problems through novel mathematical modelling, novel applications or a combination of these. Papers employing existing numerical techniques must demonstrate sufficient novelty in the solution of practical problems. Papers on fuzzy logic in decision-making or purely financial mathematics are normally not considered. Research on fractional differential equations, bifurcation, and numerical methods needs to include practical examples. Population dynamics must solve realistic scenarios. Papers in the area of logistics and business modelling should demonstrate meaningful managerial insight. Submissions with no real-world application will not be considered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信