Bin Zhu, Dong Liu, Tianyuan Liu, Fei Chen, Mingang Cao, Hongyu Wang, Siyang Liu, Yongjie Nie
{"title":"基于分布式电源终端的轻量级流处理框架","authors":"Bin Zhu, Dong Liu, Tianyuan Liu, Fei Chen, Mingang Cao, Hongyu Wang, Siyang Liu, Yongjie Nie","doi":"10.1109/PEDG56097.2023.10215224","DOIUrl":null,"url":null,"abstract":"Distributed energy sources are widely connected to the power system, and the massive amount of data they generate poses a challenge to the computation capability of the power system. Many distributed energy sources have adopted edge computing to process data locally. Currently, edge computing often performs batch processing, which requires a certain amount of storage space and has a relatively high computational delay. This paper proposes a lightweight stream processing framework, which can be built on the edge computing terminals to improve the data processing efficiency. In addition, a task allocation algorithm for the lightweight edge stream processing framework is proposed, which effectively improves the resource utilization of each computing node in the stream computing framework. Finally, the effectiveness of the proposed algorithm is verified on Huawei LiteOS emulator.","PeriodicalId":386920,"journal":{"name":"2023 IEEE 14th International Symposium on Power Electronics for Distributed Generation Systems (PEDG)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Lightweight Stream Processing Framework Based on Distributed Power Terminals\",\"authors\":\"Bin Zhu, Dong Liu, Tianyuan Liu, Fei Chen, Mingang Cao, Hongyu Wang, Siyang Liu, Yongjie Nie\",\"doi\":\"10.1109/PEDG56097.2023.10215224\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Distributed energy sources are widely connected to the power system, and the massive amount of data they generate poses a challenge to the computation capability of the power system. Many distributed energy sources have adopted edge computing to process data locally. Currently, edge computing often performs batch processing, which requires a certain amount of storage space and has a relatively high computational delay. This paper proposes a lightweight stream processing framework, which can be built on the edge computing terminals to improve the data processing efficiency. In addition, a task allocation algorithm for the lightweight edge stream processing framework is proposed, which effectively improves the resource utilization of each computing node in the stream computing framework. Finally, the effectiveness of the proposed algorithm is verified on Huawei LiteOS emulator.\",\"PeriodicalId\":386920,\"journal\":{\"name\":\"2023 IEEE 14th International Symposium on Power Electronics for Distributed Generation Systems (PEDG)\",\"volume\":\"23 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE 14th International Symposium on Power Electronics for Distributed Generation Systems (PEDG)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/PEDG56097.2023.10215224\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE 14th International Symposium on Power Electronics for Distributed Generation Systems (PEDG)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/PEDG56097.2023.10215224","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Lightweight Stream Processing Framework Based on Distributed Power Terminals
Distributed energy sources are widely connected to the power system, and the massive amount of data they generate poses a challenge to the computation capability of the power system. Many distributed energy sources have adopted edge computing to process data locally. Currently, edge computing often performs batch processing, which requires a certain amount of storage space and has a relatively high computational delay. This paper proposes a lightweight stream processing framework, which can be built on the edge computing terminals to improve the data processing efficiency. In addition, a task allocation algorithm for the lightweight edge stream processing framework is proposed, which effectively improves the resource utilization of each computing node in the stream computing framework. Finally, the effectiveness of the proposed algorithm is verified on Huawei LiteOS emulator.