{"title":"基于BiLSTM预测和改进PPO算法的投资组合模型","authors":"Xuan Zhang, Junjie Cai, Xinyue Dai, Lifeng Zhang","doi":"10.1109/isoirs57349.2022.00032","DOIUrl":null,"url":null,"abstract":"This paper develops a portfolio investment model to maximize traders’ returns of gold and bitcoin. We establish a Bidirectional Long ShortTerm Memory Network based Proximal Policy Optimization (BiLSTM-PPO) algorithm. Then, we improve the PPO algorithm by setting the penalty factor to implement a strategy in which gold does not trade on non-trading days. Finally, with the proposed BiLSTM-PPO algorithm to learn the state vector composed of historical data, covariance and BiLSTM prediction results, we obtain the optimal trading strategy. A portfolio selection case is given to illustrate the application process and effectiveness of the method. We compare the BiLSTM-PPO with traditional PPO to prove the ef-fectiveness of it. Even in the worst case, the final income increases by 6.28% than the traditional PPO. And then, we compare the BiLSTM-PPO with five common investment de-cision algorithms such as Min-Variance, Deep Deterministic Policy Gradient, and etc by six financial metrics to prove the optimality of our model. The experimental results show that the BiLSTM-PPO achieves the highest final revenue and strategy provided by the algorithm is adjusted adaptively to ensure the maximization of returns.","PeriodicalId":405065,"journal":{"name":"2022 International Symposium on Intelligent Robotics and Systems (ISoIRS)","volume":"97 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Portfolio Model Based on BiLSTM Prediction and Improved PPO Algorithm\",\"authors\":\"Xuan Zhang, Junjie Cai, Xinyue Dai, Lifeng Zhang\",\"doi\":\"10.1109/isoirs57349.2022.00032\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper develops a portfolio investment model to maximize traders’ returns of gold and bitcoin. We establish a Bidirectional Long ShortTerm Memory Network based Proximal Policy Optimization (BiLSTM-PPO) algorithm. Then, we improve the PPO algorithm by setting the penalty factor to implement a strategy in which gold does not trade on non-trading days. Finally, with the proposed BiLSTM-PPO algorithm to learn the state vector composed of historical data, covariance and BiLSTM prediction results, we obtain the optimal trading strategy. A portfolio selection case is given to illustrate the application process and effectiveness of the method. We compare the BiLSTM-PPO with traditional PPO to prove the ef-fectiveness of it. Even in the worst case, the final income increases by 6.28% than the traditional PPO. And then, we compare the BiLSTM-PPO with five common investment de-cision algorithms such as Min-Variance, Deep Deterministic Policy Gradient, and etc by six financial metrics to prove the optimality of our model. The experimental results show that the BiLSTM-PPO achieves the highest final revenue and strategy provided by the algorithm is adjusted adaptively to ensure the maximization of returns.\",\"PeriodicalId\":405065,\"journal\":{\"name\":\"2022 International Symposium on Intelligent Robotics and Systems (ISoIRS)\",\"volume\":\"97 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 International Symposium on Intelligent Robotics and Systems (ISoIRS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/isoirs57349.2022.00032\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 International Symposium on Intelligent Robotics and Systems (ISoIRS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/isoirs57349.2022.00032","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Portfolio Model Based on BiLSTM Prediction and Improved PPO Algorithm
This paper develops a portfolio investment model to maximize traders’ returns of gold and bitcoin. We establish a Bidirectional Long ShortTerm Memory Network based Proximal Policy Optimization (BiLSTM-PPO) algorithm. Then, we improve the PPO algorithm by setting the penalty factor to implement a strategy in which gold does not trade on non-trading days. Finally, with the proposed BiLSTM-PPO algorithm to learn the state vector composed of historical data, covariance and BiLSTM prediction results, we obtain the optimal trading strategy. A portfolio selection case is given to illustrate the application process and effectiveness of the method. We compare the BiLSTM-PPO with traditional PPO to prove the ef-fectiveness of it. Even in the worst case, the final income increases by 6.28% than the traditional PPO. And then, we compare the BiLSTM-PPO with five common investment de-cision algorithms such as Min-Variance, Deep Deterministic Policy Gradient, and etc by six financial metrics to prove the optimality of our model. The experimental results show that the BiLSTM-PPO achieves the highest final revenue and strategy provided by the algorithm is adjusted adaptively to ensure the maximization of returns.