{"title":"移动传感器网络最优协调的分布式策略梯度算法","authors":"J. Wang, K. Pham","doi":"10.1109/SENSORS52175.2022.9967129","DOIUrl":null,"url":null,"abstract":"In this paper, we study the optimal deployment problem in mobile sensor networks. By recasting it as an optimal coordination problem of multiagents, a new distributed policy gradient algorithm is proposed based on the minimization of the overall cost for all agents. The proposed algorithm relies on local information exchanges among neighboring agents without the requirement of known system dynamics. The policy gradient is computed based on sampling the trajectory under the perturbed control policy. The control policy is parameterized and the adaptive parameter update is carried out following the negative gradient of the overall cost. The rigorous analysis of the proposed algorithm is provided.","PeriodicalId":120357,"journal":{"name":"2022 IEEE Sensors","volume":"27 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"A Distributed Policy Gradient Algorithm for Optimal Coordination of Mobile Sensor Networks\",\"authors\":\"J. Wang, K. Pham\",\"doi\":\"10.1109/SENSORS52175.2022.9967129\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, we study the optimal deployment problem in mobile sensor networks. By recasting it as an optimal coordination problem of multiagents, a new distributed policy gradient algorithm is proposed based on the minimization of the overall cost for all agents. The proposed algorithm relies on local information exchanges among neighboring agents without the requirement of known system dynamics. The policy gradient is computed based on sampling the trajectory under the perturbed control policy. The control policy is parameterized and the adaptive parameter update is carried out following the negative gradient of the overall cost. The rigorous analysis of the proposed algorithm is provided.\",\"PeriodicalId\":120357,\"journal\":{\"name\":\"2022 IEEE Sensors\",\"volume\":\"27 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE Sensors\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SENSORS52175.2022.9967129\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE Sensors","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SENSORS52175.2022.9967129","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Distributed Policy Gradient Algorithm for Optimal Coordination of Mobile Sensor Networks
In this paper, we study the optimal deployment problem in mobile sensor networks. By recasting it as an optimal coordination problem of multiagents, a new distributed policy gradient algorithm is proposed based on the minimization of the overall cost for all agents. The proposed algorithm relies on local information exchanges among neighboring agents without the requirement of known system dynamics. The policy gradient is computed based on sampling the trajectory under the perturbed control policy. The control policy is parameterized and the adaptive parameter update is carried out following the negative gradient of the overall cost. The rigorous analysis of the proposed algorithm is provided.