采用强化学习的结构主动控制框架

Soheil Sadeghi Eshkevari, S. S. Eshkevari, Debarshi Sen, S. Pakzad
{"title":"采用强化学习的结构主动控制框架","authors":"Soheil Sadeghi Eshkevari, S. S. Eshkevari, Debarshi Sen, S. Pakzad","doi":"10.12783/shm2021/36293","DOIUrl":null,"url":null,"abstract":"To maintain structural integrity and functionality structures are designed to accommodate operational loads as well as natural hazards during their lifetime. Active control systems are an efficient solution for structural response control when a structure is subjected to unexpected extreme loads. However, development of these systems through traditional means is limited by their model dependent nature. Recent advancements in adaptive learning methods, in particular, reinforcement learning (RL), for real-time decision-making problems, along with rapid growth in high-performance computational resources, enable structural engineers to transform the classic modelbased active control problem to a purely data-driven one. In this paper, we present a novel RL-based approach for designing active controllers by introducing RL-Controller, a flexible and scalable simulation environment. RL-Controller includes attributes and functionalities that are necessary to model active structural control mechanisms in detail. We show that the proposed framework is easily trainable for a five-story benchmark linear building with 65% reductions on average in inter story drifts (ISD) when subjected to strong ground motions. In a comparative study with an LQG active controller, we demonstrate that the proposed model-free algorithm learns actuator forcing strategies that yield higher performance, e.g., 25% more ISD reductions on average with respect to LQG, without using prior information about the mechanical properties of the system.","PeriodicalId":180083,"journal":{"name":"Proceedings of the 13th International Workshop on Structural Health Monitoring","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"STRUCTURAL ACTIVE CONTROL FRAMEWORK USING REINFORCEMENT LEARNING\",\"authors\":\"Soheil Sadeghi Eshkevari, S. S. Eshkevari, Debarshi Sen, S. Pakzad\",\"doi\":\"10.12783/shm2021/36293\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"To maintain structural integrity and functionality structures are designed to accommodate operational loads as well as natural hazards during their lifetime. Active control systems are an efficient solution for structural response control when a structure is subjected to unexpected extreme loads. However, development of these systems through traditional means is limited by their model dependent nature. Recent advancements in adaptive learning methods, in particular, reinforcement learning (RL), for real-time decision-making problems, along with rapid growth in high-performance computational resources, enable structural engineers to transform the classic modelbased active control problem to a purely data-driven one. In this paper, we present a novel RL-based approach for designing active controllers by introducing RL-Controller, a flexible and scalable simulation environment. RL-Controller includes attributes and functionalities that are necessary to model active structural control mechanisms in detail. We show that the proposed framework is easily trainable for a five-story benchmark linear building with 65% reductions on average in inter story drifts (ISD) when subjected to strong ground motions. In a comparative study with an LQG active controller, we demonstrate that the proposed model-free algorithm learns actuator forcing strategies that yield higher performance, e.g., 25% more ISD reductions on average with respect to LQG, without using prior information about the mechanical properties of the system.\",\"PeriodicalId\":180083,\"journal\":{\"name\":\"Proceedings of the 13th International Workshop on Structural Health Monitoring\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-03-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 13th International Workshop on Structural Health Monitoring\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.12783/shm2021/36293\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 13th International Workshop on Structural Health Monitoring","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.12783/shm2021/36293","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

为了保持结构的完整性和功能性,结构的设计可以适应其使用寿命期间的运行负荷和自然灾害。主动控制系统是结构在承受非预期极端荷载时进行结构响应控制的有效方法。然而,通过传统手段开发这些系统受到其模型依赖性质的限制。自适应学习方法的最新进展,特别是用于实时决策问题的强化学习(RL),以及高性能计算资源的快速增长,使结构工程师能够将经典的基于模型的主动控制问题转变为纯粹的数据驱动问题。在本文中,我们提出了一种新颖的基于rl的主动控制器设计方法,通过引入rl控制器,一个灵活和可扩展的仿真环境。RL-Controller包括对主动结构控制机制进行详细建模所必需的属性和功能。我们表明,对于一个五层基准线性建筑,所提出的框架很容易训练,当受到强烈的地面运动时,层间漂移(ISD)平均减少65%。在与LQG主动控制器的比较研究中,我们证明了所提出的无模型算法可以学习执行器强制策略,从而产生更高的性能,例如,相对于LQG,在不使用有关系统机械特性的先验信息的情况下,平均减少25%的ISD。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
STRUCTURAL ACTIVE CONTROL FRAMEWORK USING REINFORCEMENT LEARNING
To maintain structural integrity and functionality structures are designed to accommodate operational loads as well as natural hazards during their lifetime. Active control systems are an efficient solution for structural response control when a structure is subjected to unexpected extreme loads. However, development of these systems through traditional means is limited by their model dependent nature. Recent advancements in adaptive learning methods, in particular, reinforcement learning (RL), for real-time decision-making problems, along with rapid growth in high-performance computational resources, enable structural engineers to transform the classic modelbased active control problem to a purely data-driven one. In this paper, we present a novel RL-based approach for designing active controllers by introducing RL-Controller, a flexible and scalable simulation environment. RL-Controller includes attributes and functionalities that are necessary to model active structural control mechanisms in detail. We show that the proposed framework is easily trainable for a five-story benchmark linear building with 65% reductions on average in inter story drifts (ISD) when subjected to strong ground motions. In a comparative study with an LQG active controller, we demonstrate that the proposed model-free algorithm learns actuator forcing strategies that yield higher performance, e.g., 25% more ISD reductions on average with respect to LQG, without using prior information about the mechanical properties of the system.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信