基于自适应加权强化学习的非线性过程多目标最优控制

IF 3.9 2区 工程技术 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Yujia Wang , Zhiyuan Wang , Zhe Wu
{"title":"基于自适应加权强化学习的非线性过程多目标最优控制","authors":"Yujia Wang ,&nbsp;Zhiyuan Wang ,&nbsp;Zhe Wu","doi":"10.1016/j.compchemeng.2025.109206","DOIUrl":null,"url":null,"abstract":"<div><div>This work proposes a reinforcement learning (RL) framework for solving multi-objective optimal control problems for nonlinear systems. The non-dominated sorting genetic algorithm II (NSGA-II) is integrated into the RL framework to first compute a set of Pareto-optimal solutions that will be used to design adaptive weights. Unlike conventional fixed-weight methods, the proposed framework dynamically adjusts the weights of multiple objectives in response to varying process conditions to improve the trade-off among multiple objectives. Policy iteration is used to optimize control policies under the adaptive weights. The proposed framework is applied to a nonlinear chemical process to demonstrate its effectiveness and superiority over fixed-weight learning methods.</div></div>","PeriodicalId":286,"journal":{"name":"Computers & Chemical Engineering","volume":"201 ","pages":"Article 109206"},"PeriodicalIF":3.9000,"publicationDate":"2025-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multi-objective optimal control of nonlinear processes using reinforcement learning with adaptive weighting\",\"authors\":\"Yujia Wang ,&nbsp;Zhiyuan Wang ,&nbsp;Zhe Wu\",\"doi\":\"10.1016/j.compchemeng.2025.109206\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>This work proposes a reinforcement learning (RL) framework for solving multi-objective optimal control problems for nonlinear systems. The non-dominated sorting genetic algorithm II (NSGA-II) is integrated into the RL framework to first compute a set of Pareto-optimal solutions that will be used to design adaptive weights. Unlike conventional fixed-weight methods, the proposed framework dynamically adjusts the weights of multiple objectives in response to varying process conditions to improve the trade-off among multiple objectives. Policy iteration is used to optimize control policies under the adaptive weights. The proposed framework is applied to a nonlinear chemical process to demonstrate its effectiveness and superiority over fixed-weight learning methods.</div></div>\",\"PeriodicalId\":286,\"journal\":{\"name\":\"Computers & Chemical Engineering\",\"volume\":\"201 \",\"pages\":\"Article 109206\"},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2025-06-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Computers & Chemical Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0098135425002108\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers & Chemical Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0098135425002108","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

本文提出了一个用于求解非线性系统多目标最优控制问题的强化学习(RL)框架。将非支配排序遗传算法II (NSGA-II)集成到RL框架中,首先计算一组pareto最优解,这些解将用于设计自适应权重。与传统的固定权值方法不同,该框架根据不同的过程条件动态调整多目标的权值,以改善多目标之间的权衡。在自适应权值下,采用策略迭代优化控制策略。将所提出的框架应用于一个非线性化学过程,证明了它比固定权值学习方法的有效性和优越性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Multi-objective optimal control of nonlinear processes using reinforcement learning with adaptive weighting
This work proposes a reinforcement learning (RL) framework for solving multi-objective optimal control problems for nonlinear systems. The non-dominated sorting genetic algorithm II (NSGA-II) is integrated into the RL framework to first compute a set of Pareto-optimal solutions that will be used to design adaptive weights. Unlike conventional fixed-weight methods, the proposed framework dynamically adjusts the weights of multiple objectives in response to varying process conditions to improve the trade-off among multiple objectives. Policy iteration is used to optimize control policies under the adaptive weights. The proposed framework is applied to a nonlinear chemical process to demonstrate its effectiveness and superiority over fixed-weight learning methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Computers & Chemical Engineering
Computers & Chemical Engineering 工程技术-工程:化工
CiteScore
8.70
自引率
14.00%
发文量
374
审稿时长
70 days
期刊介绍: Computers & Chemical Engineering is primarily a journal of record for new developments in the application of computing and systems technology to chemical engineering problems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信