Optical stabilization for laser communication satellite systems through proportional-integral-derivative (PID) control and reinforcement learning approach.
A Reutov, S Vorobey, A Katanskiy, V Balakirev, R Bakhshaliev, K Barbyshev, V Merzlinkin, V Tekaev
{"title":"Optical stabilization for laser communication satellite systems through proportional-integral-derivative (PID) control and reinforcement learning approach.","authors":"A Reutov, S Vorobey, A Katanskiy, V Balakirev, R Bakhshaliev, K Barbyshev, V Merzlinkin, V Tekaev","doi":"10.1063/5.0239029","DOIUrl":null,"url":null,"abstract":"<p><p>One of the main issues of the satellite-to-ground optical communication, including free-space satellite quantum key distribution (QKD), is an achievement of the reasonable accuracy of positioning, navigation, and optical stabilization. Proportional-integral-derivative (PID) controllers can handle various control tasks in optical systems. Recent research shows the promising results in the area of composite control systems including classical control via PID controllers and reinforcement learning (RL) approach. In this work, we apply a RL agent to an experimental stand of the optical stabilization system of the QKD terminal. We find via agent control history more precise PID parameters and also provide an effective combined RL-PID dynamic control approach for the optical stabilization of the satellite-to-ground communication system.</p>","PeriodicalId":21111,"journal":{"name":"Review of Scientific Instruments","volume":"96 3","pages":""},"PeriodicalIF":1.3000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Review of Scientific Instruments","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1063/5.0239029","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"INSTRUMENTS & INSTRUMENTATION","Score":null,"Total":0}
引用次数: 0
Abstract
One of the main issues of the satellite-to-ground optical communication, including free-space satellite quantum key distribution (QKD), is an achievement of the reasonable accuracy of positioning, navigation, and optical stabilization. Proportional-integral-derivative (PID) controllers can handle various control tasks in optical systems. Recent research shows the promising results in the area of composite control systems including classical control via PID controllers and reinforcement learning (RL) approach. In this work, we apply a RL agent to an experimental stand of the optical stabilization system of the QKD terminal. We find via agent control history more precise PID parameters and also provide an effective combined RL-PID dynamic control approach for the optical stabilization of the satellite-to-ground communication system.
期刊介绍:
Review of Scientific Instruments, is committed to the publication of advances in scientific instruments, apparatuses, and techniques. RSI seeks to meet the needs of engineers and scientists in physics, chemistry, and the life sciences.