Parametric and reinforcement learning control for degrading multi-stage systems

Panagiotis D. Paraschos , Georgios K. Koulinas , Dimitrios E. Koulouriotis
{"title":"Parametric and reinforcement learning control for degrading multi-stage systems","authors":"Panagiotis D. Paraschos ,&nbsp;Georgios K. Koulinas ,&nbsp;Dimitrios E. Koulouriotis","doi":"10.1016/j.promfg.2021.10.055","DOIUrl":null,"url":null,"abstract":"<div><p>This paper addresses the joint control problem in the context of a two-stage stochastic manufacturing/remanufacturing system, which involve both manufacturing and remanufacturing processes. Its operability is affected by frequent deterioration failures. Along with the condition of the system, the manufactured items are affected as well. Thus, the system obtains lesser revenues due to the low-quality products and the downtimes of the deteriorated system. For this purpose, the state and the condition of the systems and the manufactured products must be monitored dynamically so as to devise an optimal strategy for manufacturing, maintenance, and quality control. The present paper proposes a novel two-agent reinforcement learning framework that incorporates parametric production and maintenance activities. The aim is to improve the productivity of the system and keep the system operational with minimal maintenance activities so as to maximize the overall profitability. The performance of the presented approach is evaluated through experimental scenarios.</p></div>","PeriodicalId":91947,"journal":{"name":"Procedia manufacturing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2351978921002523/pdf?md5=972ef873dd66b3e1057b0153fcb026be&pid=1-s2.0-S2351978921002523-main.pdf","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Procedia manufacturing","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2351978921002523","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

Abstract

This paper addresses the joint control problem in the context of a two-stage stochastic manufacturing/remanufacturing system, which involve both manufacturing and remanufacturing processes. Its operability is affected by frequent deterioration failures. Along with the condition of the system, the manufactured items are affected as well. Thus, the system obtains lesser revenues due to the low-quality products and the downtimes of the deteriorated system. For this purpose, the state and the condition of the systems and the manufactured products must be monitored dynamically so as to devise an optimal strategy for manufacturing, maintenance, and quality control. The present paper proposes a novel two-agent reinforcement learning framework that incorporates parametric production and maintenance activities. The aim is to improve the productivity of the system and keep the system operational with minimal maintenance activities so as to maximize the overall profitability. The performance of the presented approach is evaluated through experimental scenarios.

退化多级系统的参数化和强化学习控制
本文研究了两阶段随机制造/再制造系统的联合控制问题,该系统涉及制造过程和再制造过程。频繁的劣化故障影响了其可操作性。随着系统的状况,制造项目也受到影响。因此,由于产品质量低下和系统恶化的停机时间,系统获得的收益较少。为此,必须对系统和制造产品的状态和条件进行动态监测,以便为制造、维护和质量控制设计最佳策略。本文提出了一种新的包含参数化生产和维护活动的双智能体强化学习框架。其目的是提高系统的生产力,并以最少的维护活动保持系统的运行,从而最大化整体盈利能力。通过实验场景对所提出的方法的性能进行了评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信