将图像处理与群体检测算法相结合的风能异常数据清理方法

IF 1.9 Q4 ENERGY & FUELS
Qiaoling Yang, Kai Chen, Jianzhang Man, Jiaheng Duan, Zuoqi Jin
{"title":"将图像处理与群体检测算法相结合的风能异常数据清理方法","authors":"Qiaoling Yang,&nbsp;Kai Chen,&nbsp;Jianzhang Man,&nbsp;Jiaheng Duan,&nbsp;Zuoqi Jin","doi":"10.1016/j.gloei.2024.06.001","DOIUrl":null,"url":null,"abstract":"<div><p>Current methodologies for cleaning wind power anomaly data exhibit limited capabilities in identifying abnormal data within extensive datasets and struggle to accommodate the considerable variability and intricacy of wind farm data. Consequently, a method for cleaning wind power anomaly data by combining image processing with community detection algorithms (CWPAD-IPCDA) is proposed. To precisely identify and initially clean anomalous data, wind power curve (WPC) images are converted into graph structures, which employ the Louvain community recognition algorithm and graph- theoretic methods for community detection and segmentation. Furthermore, the mathematical morphology operation (MMO) determines the main part of the initially cleaned wind power curve images and maps them back to the normal wind power points to complete the final cleaning. The CWPAD-IPCDA method was applied to clean datasets from 25 wind turbines (WTs) in two wind farms in northwest China to validate its feasibility. A comparison was conducted using density-based spatial clustering of applications with noise (DBSCAN) algorithm, an improved isolation forest algorithm, and an image-based (IB) algorithm. The experimental results demonstrate that the CWPAD-IPCDA method surpasses the other three algorithms, achieving an approximately 7.23% higher average data cleaning rate. The mean value of the sum of the squared errors (SSE) of the dataset after cleaning is approximately 6.887 lower than that of the other algorithms. Moreover, the mean of overall accuracy, as measured by the F1-score, exceeds that of the other methods by approximately 10.49%; this indicates that the CWPAD-IPCDA method is more conducive to improving the accuracy and reliability of wind power curve modeling and wind farm power forecasting.</p></div>","PeriodicalId":36174,"journal":{"name":"Global Energy Interconnection","volume":"7 3","pages":"Pages 293-312"},"PeriodicalIF":1.9000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2096511724000409/pdf?md5=76bef55c59575e27e863e1a13c83d015&pid=1-s2.0-S2096511724000409-main.pdf","citationCount":"0","resultStr":"{\"title\":\"A method for cleaning wind power anomaly data by combining image processing with community detection algorithms\",\"authors\":\"Qiaoling Yang,&nbsp;Kai Chen,&nbsp;Jianzhang Man,&nbsp;Jiaheng Duan,&nbsp;Zuoqi Jin\",\"doi\":\"10.1016/j.gloei.2024.06.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Current methodologies for cleaning wind power anomaly data exhibit limited capabilities in identifying abnormal data within extensive datasets and struggle to accommodate the considerable variability and intricacy of wind farm data. Consequently, a method for cleaning wind power anomaly data by combining image processing with community detection algorithms (CWPAD-IPCDA) is proposed. To precisely identify and initially clean anomalous data, wind power curve (WPC) images are converted into graph structures, which employ the Louvain community recognition algorithm and graph- theoretic methods for community detection and segmentation. Furthermore, the mathematical morphology operation (MMO) determines the main part of the initially cleaned wind power curve images and maps them back to the normal wind power points to complete the final cleaning. The CWPAD-IPCDA method was applied to clean datasets from 25 wind turbines (WTs) in two wind farms in northwest China to validate its feasibility. A comparison was conducted using density-based spatial clustering of applications with noise (DBSCAN) algorithm, an improved isolation forest algorithm, and an image-based (IB) algorithm. The experimental results demonstrate that the CWPAD-IPCDA method surpasses the other three algorithms, achieving an approximately 7.23% higher average data cleaning rate. The mean value of the sum of the squared errors (SSE) of the dataset after cleaning is approximately 6.887 lower than that of the other algorithms. Moreover, the mean of overall accuracy, as measured by the F1-score, exceeds that of the other methods by approximately 10.49%; this indicates that the CWPAD-IPCDA method is more conducive to improving the accuracy and reliability of wind power curve modeling and wind farm power forecasting.</p></div>\",\"PeriodicalId\":36174,\"journal\":{\"name\":\"Global Energy Interconnection\",\"volume\":\"7 3\",\"pages\":\"Pages 293-312\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2024-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2096511724000409/pdf?md5=76bef55c59575e27e863e1a13c83d015&pid=1-s2.0-S2096511724000409-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Global Energy Interconnection\",\"FirstCategoryId\":\"1087\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2096511724000409\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Global Energy Interconnection","FirstCategoryId":"1087","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2096511724000409","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

摘要

目前用于清理风电异常数据的方法在识别大量数据集中的异常数据方面能力有限,并且难以适应风电场数据的可变性和复杂性。因此,我们提出了一种结合图像处理和群体检测算法的风电异常数据清理方法(CWPAD-IPCDA)。为了精确识别和初步清理异常数据,将风力曲线(WPC)图像转换成图结构,采用卢万群落识别算法和图论方法进行群落检测和分割。此外,数学形态学运算(MMO)可确定初步清理的风力曲线图像的主要部分,并将其映射回正常风力点,从而完成最终清理。为了验证 CWPAD-IPCDA 方法的可行性,我们将其应用于中国西北部两个风电场 25 台风机的清洁数据集。使用基于密度的带噪声应用空间聚类算法(DBSCAN)、改进的隔离林算法和基于图像的算法(IB)进行了比较。实验结果表明,CWPAD-IPCDA 方法超过了其他三种算法,平均数据清理率提高了约 7.23%。清洗后数据集的平方误差之和(SSE)的平均值比其他算法低约 6.887。此外,用 F1 分数衡量的总体准确度均值比其他方法高出约 10.49%,这表明 CWPAD-IPCDA 方法更有利于提高风能曲线建模和风电场功率预测的准确性和可靠性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A method for cleaning wind power anomaly data by combining image processing with community detection algorithms

Current methodologies for cleaning wind power anomaly data exhibit limited capabilities in identifying abnormal data within extensive datasets and struggle to accommodate the considerable variability and intricacy of wind farm data. Consequently, a method for cleaning wind power anomaly data by combining image processing with community detection algorithms (CWPAD-IPCDA) is proposed. To precisely identify and initially clean anomalous data, wind power curve (WPC) images are converted into graph structures, which employ the Louvain community recognition algorithm and graph- theoretic methods for community detection and segmentation. Furthermore, the mathematical morphology operation (MMO) determines the main part of the initially cleaned wind power curve images and maps them back to the normal wind power points to complete the final cleaning. The CWPAD-IPCDA method was applied to clean datasets from 25 wind turbines (WTs) in two wind farms in northwest China to validate its feasibility. A comparison was conducted using density-based spatial clustering of applications with noise (DBSCAN) algorithm, an improved isolation forest algorithm, and an image-based (IB) algorithm. The experimental results demonstrate that the CWPAD-IPCDA method surpasses the other three algorithms, achieving an approximately 7.23% higher average data cleaning rate. The mean value of the sum of the squared errors (SSE) of the dataset after cleaning is approximately 6.887 lower than that of the other algorithms. Moreover, the mean of overall accuracy, as measured by the F1-score, exceeds that of the other methods by approximately 10.49%; this indicates that the CWPAD-IPCDA method is more conducive to improving the accuracy and reliability of wind power curve modeling and wind farm power forecasting.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Global Energy Interconnection
Global Energy Interconnection Engineering-Automotive Engineering
CiteScore
5.70
自引率
0.00%
发文量
985
审稿时长
15 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信