{"title":"Dynamic pricing and inventory control of perishable products by a deep reinforcement learning algorithm","authors":"Alireza Kavoosi , Reza Tavakkoli-Moghaddam , Hedieh Sajedi , Nazanin Tajik , Keivan Tafakkori","doi":"10.1016/j.eswa.2025.128570","DOIUrl":null,"url":null,"abstract":"<div><div>Using continuous action spaces to set prices simultaneously and order quantities, this study proposes a unified deep reinforcement learning (DRL) framework for dynamic pricing and perishables inventory control in a vendor-managed environment. Sales revenue plus penalties for spoiling, returns, and transport costs are combined to create a multi-component reward that reflects profit. We incorporate a potential-based shaping term <span><math><mrow><mstyle><mi>Φ</mi></mstyle><mo>(</mo><mi>s</mi><mo>)</mo></mrow></math></span> constructed from inventory heuristics to direct exploration and shorten training time, guaranteeing no change in policy optimality. In contrast to other DRL algorithms and classical benchmarks, our empirical study, which includes seasonal demand and random returns, shows that an agent based on proximal policy optimization achieves better cumulative reward and service level.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"291 ","pages":"Article 128570"},"PeriodicalIF":7.5000,"publicationDate":"2025-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S095741742502189X","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Using continuous action spaces to set prices simultaneously and order quantities, this study proposes a unified deep reinforcement learning (DRL) framework for dynamic pricing and perishables inventory control in a vendor-managed environment. Sales revenue plus penalties for spoiling, returns, and transport costs are combined to create a multi-component reward that reflects profit. We incorporate a potential-based shaping term constructed from inventory heuristics to direct exploration and shorten training time, guaranteeing no change in policy optimality. In contrast to other DRL algorithms and classical benchmarks, our empirical study, which includes seasonal demand and random returns, shows that an agent based on proximal policy optimization achieves better cumulative reward and service level.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.