Feng Wang , Shicheng Li , Shanshui Niu , Haoran Yang , Xiaodong Li , Xiaotie Deng
{"title":"A Survey on recent advances in reinforcement learning for intelligent investment decision-making optimization","authors":"Feng Wang , Shicheng Li , Shanshui Niu , Haoran Yang , Xiaodong Li , Xiaotie Deng","doi":"10.1016/j.eswa.2025.127540","DOIUrl":null,"url":null,"abstract":"<div><div>Reinforcement learning (RL) has emerged as a powerful tool for optimizing intelligent investment decision-making. With the rapid evolution of financial markets, traditional approaches often struggle to effectively analyze the vast and complex datasets involved. RL-based methods address these challenges by leveraging neural networks to process large-scale financial data, dynamically interacting with market environments to refine strategies, and designing tailored reward functions to achieve diverse investment objectives. This paper provides a comprehensive review of recent advancements in RL for investment decision-making, with a focus on four key areas, i.e., portfolio selection, trade execution, options hedging, and market making. These four problems represent highly challenging instances of multi-stage , multi-objective decision optimization in investment, highlighting the strengths of RL-based methods in effectively balancing trade-offs among different objectives over time. Detailed comparison work of state-of-the-art RL-based methods is presented, analyzing the action spaces, state representations, reward structures, and neural network architectures. Finally, the paper discusses some new challenges and point out some directions for future research in the field.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"282 ","pages":"Article 127540"},"PeriodicalIF":7.5000,"publicationDate":"2025-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425011625","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Reinforcement learning (RL) has emerged as a powerful tool for optimizing intelligent investment decision-making. With the rapid evolution of financial markets, traditional approaches often struggle to effectively analyze the vast and complex datasets involved. RL-based methods address these challenges by leveraging neural networks to process large-scale financial data, dynamically interacting with market environments to refine strategies, and designing tailored reward functions to achieve diverse investment objectives. This paper provides a comprehensive review of recent advancements in RL for investment decision-making, with a focus on four key areas, i.e., portfolio selection, trade execution, options hedging, and market making. These four problems represent highly challenging instances of multi-stage , multi-objective decision optimization in investment, highlighting the strengths of RL-based methods in effectively balancing trade-offs among different objectives over time. Detailed comparison work of state-of-the-art RL-based methods is presented, analyzing the action spaces, state representations, reward structures, and neural network architectures. Finally, the paper discusses some new challenges and point out some directions for future research in the field.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.