Renato A. de Oliveira, Heitor Soares Ramos Filho, D. H. Dalip, A. Pereira
{"title":"A tabular sarsa-based stock market agent","authors":"Renato A. de Oliveira, Heitor Soares Ramos Filho, D. H. Dalip, A. Pereira","doi":"10.1145/3383455.3422559","DOIUrl":null,"url":null,"abstract":"Automated stock trading is now the de-facto way that investors have chosen to obtain high profits in the stock market while keeping risk under control. One of the approaches is to create agents employing Reinforcement Learning (RL) algorithms to learn and decide whether or not to operate in the market in order to achieve maximum profit. Automated financial trading systems can learn how to trade optimally while interacting with the market pretty much like a human investor learns how to trade. In this research, a simple RL agent was implemented using the SARSA algorithm. Next, it was tested against 10 stocks from Brazilian stock market B3 (Bolsa, Brasil, Balcão). Results from experiments showed that the agent was able to provide high profits with less risk when compared to a supervised learning agent that used a LSTM neural network.","PeriodicalId":447950,"journal":{"name":"Proceedings of the First ACM International Conference on AI in Finance","volume":"10 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"7","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the First ACM International Conference on AI in Finance","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3383455.3422559","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 7
Abstract
Automated stock trading is now the de-facto way that investors have chosen to obtain high profits in the stock market while keeping risk under control. One of the approaches is to create agents employing Reinforcement Learning (RL) algorithms to learn and decide whether or not to operate in the market in order to achieve maximum profit. Automated financial trading systems can learn how to trade optimally while interacting with the market pretty much like a human investor learns how to trade. In this research, a simple RL agent was implemented using the SARSA algorithm. Next, it was tested against 10 stocks from Brazilian stock market B3 (Bolsa, Brasil, Balcão). Results from experiments showed that the agent was able to provide high profits with less risk when compared to a supervised learning agent that used a LSTM neural network.
自动化股票交易现在是投资者在控制风险的同时获得高额利润的一种事实上的方式。其中一种方法是创建使用强化学习(RL)算法的智能体,以学习和决定是否在市场中操作以获得最大利润。自动金融交易系统可以学习如何在与市场互动的同时进行最佳交易,就像人类投资者学习如何交易一样。在本研究中,使用SARSA算法实现了一个简单的RL代理。接下来,对巴西B3股票市场(Bolsa, Brasil, balc)的10只股票进行测试。实验结果表明,与使用LSTM神经网络的监督学习代理相比,该代理能够提供高利润和低风险。