Allerton Conference on Communication, Control, and Computing最新文献

筛选

英文中文

Data Efficient Learning of Robust Control Policies 鲁棒控制策略的数据高效学习

Allerton Conference on Communication, Control, and Computing Pub Date : 2018-10-01 DOI: 10.1109/ALLERTON.2018.8636072

Susmit Jha, P. Lincoln

{"title":"Data Efficient Learning of Robust Control Policies","authors":"Susmit Jha, P. Lincoln","doi":"10.1109/ALLERTON.2018.8636072","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8636072","url":null,"abstract":"This paper investigates data-efficient methods for learning robust control policies. Reinforcement learning has emerged as an effective approach to learn control policies by interacting directly with the plant, but it requires a significant number of example trajectories to converge to the optimal policy. Combining model-free reinforcement learning with model-based control methods achieves better data-efficiency via simultaneous system identification and controller synthesis. We study a novel approach that exploits the existence of approximate physics models to accelerate the learning of control policies. The proposed approach consists of iterating through three key steps: evaluating a selected policy on the real-world plant and recording trajectories, building a Gaussian process model to predict the reality-gap of a parametric physics model in the neighborhood of the selected policy, and synthesizing a new policy using reinforcement learning on the refined physics model that most likely approximates the real plant. The approach converges to an optimal policy as well as an approximate physics model. The real world experiments are limited to evaluating only promising candidate policies, and the use of Gaussian processes minimizes the number of required real world trajectories. We demonstrate the effectiveness of our techniques on a set of simulation case-studies using OpenAI gym environments.","PeriodicalId":175228,"journal":{"name":"Allerton Conference on Communication, Control, and Computing","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114068652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Potential conditional mutual information: Estimators and properties 潜在条件互信息:估计量和性质

Allerton Conference on Communication, Control, and Computing Pub Date : 2017-10-13 DOI: 10.1109/ALLERTON.2017.8262877

Arman Rahimzamani, Sreeram Kannan

引用次数: 9

On the degrees of freedom of SISO interference and X channels with delayed CSIT 延迟CSIT下SISO干扰和X信道的自由度

Allerton Conference on Communication, Control, and Computing Pub Date : 2011-09-01 DOI: 10.1109/Allerton.2011.6120226

Mohammad Javad Abdoli, A. Ghasemi, A. Khandani

引用次数: 19