Bara Masalmeh;Rashmi Prasad;Vaibhav Nougain;Aleksandra Lekić
{"title":"神经网络在RSCAD中的应用:用先进的机器学习增强基于mmc的HVDC仿真","authors":"Bara Masalmeh;Rashmi Prasad;Vaibhav Nougain;Aleksandra Lekić","doi":"10.1109/TIA.2025.3529804","DOIUrl":null,"url":null,"abstract":"The potential of advanced neural networks (NNs) has yet to be explored in the field of HVDC transmission. Implementing such intelligent computational techniques on a real-time digital simulator (RTDS) is challenging due to the need for rapid computation and the risk of overfitting with extensive data generated at tiny time steps. To overcome these limitations, different NN techniques are studied using a supervised and reinforced imitation learning method to mimic the suggested controller with labeled data for real-time applications. Furthermore, the NN component does not necessarily just take a label, and therefore, the authors propose a more advanced approach by incorporating reinforced learning through an error-tracking mechanism into the NN, apart from its loss function. The initial offline processing identifies the best-suited NN technique for online computational feasibility. Both online and offline training methods as well as online adjustments are showcased to provide a robust control solution that is easy to implement. This work deals with developing an intuitive and versatile Toolbox installed on a real-time simulator platform that can integrate complex NN-based control strategies. Extensive simulations on the RTDS platform and experimental investigations of the four terminal HVDC systems validate the interest and viability of the proposed design methodology.","PeriodicalId":13337,"journal":{"name":"IEEE Transactions on Industry Applications","volume":"61 2","pages":"2515-2526"},"PeriodicalIF":4.2000,"publicationDate":"2025-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Neural Networks in RSCAD: Enhancing MMC-Based HVDC Simulation With Advanced Machine Learning\",\"authors\":\"Bara Masalmeh;Rashmi Prasad;Vaibhav Nougain;Aleksandra Lekić\",\"doi\":\"10.1109/TIA.2025.3529804\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The potential of advanced neural networks (NNs) has yet to be explored in the field of HVDC transmission. Implementing such intelligent computational techniques on a real-time digital simulator (RTDS) is challenging due to the need for rapid computation and the risk of overfitting with extensive data generated at tiny time steps. To overcome these limitations, different NN techniques are studied using a supervised and reinforced imitation learning method to mimic the suggested controller with labeled data for real-time applications. Furthermore, the NN component does not necessarily just take a label, and therefore, the authors propose a more advanced approach by incorporating reinforced learning through an error-tracking mechanism into the NN, apart from its loss function. The initial offline processing identifies the best-suited NN technique for online computational feasibility. Both online and offline training methods as well as online adjustments are showcased to provide a robust control solution that is easy to implement. This work deals with developing an intuitive and versatile Toolbox installed on a real-time simulator platform that can integrate complex NN-based control strategies. Extensive simulations on the RTDS platform and experimental investigations of the four terminal HVDC systems validate the interest and viability of the proposed design methodology.\",\"PeriodicalId\":13337,\"journal\":{\"name\":\"IEEE Transactions on Industry Applications\",\"volume\":\"61 2\",\"pages\":\"2515-2526\"},\"PeriodicalIF\":4.2000,\"publicationDate\":\"2025-01-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Industry Applications\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10839569/\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Industry Applications","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10839569/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
摘要
高级神经网络(NN)在高压直流输电领域的潜力尚待开发。在实时数字模拟器(RTDS)上实现这种智能计算技术具有挑战性,因为需要快速计算,而且在微小的时间步长内产生的大量数据有可能造成过度拟合。为了克服这些限制,我们研究了不同的 NN 技术,采用监督和强化模仿学习方法,利用实时应用中的标记数据模仿建议的控制器。此外,NN 组件并不一定只接受标签,因此作者提出了一种更先进的方法,即在 NN 的损失函数之外,通过错误跟踪机制将强化学习纳入 NN。最初的离线处理确定了最适合在线计算可行性的 NN 技术。同时展示了在线和离线训练方法以及在线调整,以提供易于实施的稳健控制解决方案。这项工作涉及开发一个安装在实时模拟器平台上的直观且功能多样的工具箱,该工具箱可集成基于 NN 的复杂控制策略。在 RTDS 平台上进行的大量仿真和对四个终端高压直流系统的实验研究验证了所提出的设计方法的意义和可行性。
Neural Networks in RSCAD: Enhancing MMC-Based HVDC Simulation With Advanced Machine Learning
The potential of advanced neural networks (NNs) has yet to be explored in the field of HVDC transmission. Implementing such intelligent computational techniques on a real-time digital simulator (RTDS) is challenging due to the need for rapid computation and the risk of overfitting with extensive data generated at tiny time steps. To overcome these limitations, different NN techniques are studied using a supervised and reinforced imitation learning method to mimic the suggested controller with labeled data for real-time applications. Furthermore, the NN component does not necessarily just take a label, and therefore, the authors propose a more advanced approach by incorporating reinforced learning through an error-tracking mechanism into the NN, apart from its loss function. The initial offline processing identifies the best-suited NN technique for online computational feasibility. Both online and offline training methods as well as online adjustments are showcased to provide a robust control solution that is easy to implement. This work deals with developing an intuitive and versatile Toolbox installed on a real-time simulator platform that can integrate complex NN-based control strategies. Extensive simulations on the RTDS platform and experimental investigations of the four terminal HVDC systems validate the interest and viability of the proposed design methodology.
期刊介绍:
The scope of the IEEE Transactions on Industry Applications includes all scope items of the IEEE Industry Applications Society, that is, the advancement of the theory and practice of electrical and electronic engineering in the development, design, manufacture, and application of electrical systems, apparatus, devices, and controls to the processes and equipment of industry and commerce; the promotion of safe, reliable, and economic installations; industry leadership in energy conservation and environmental, health, and safety issues; the creation of voluntary engineering standards and recommended practices; and the professional development of its membership.