Richard Liaw, Paige Bailey, Ying Li, Maria Dimakopoulou, Yves Raimond
{"title":"2022年:基于强化学习的大规模推荐系统","authors":"Richard Liaw, Paige Bailey, Ying Li, Maria Dimakopoulou, Yves Raimond","doi":"10.1145/3523227.3547418","DOIUrl":null,"url":null,"abstract":"Recommendation systems are increasingly modelled as a sequential decision making process, where the system decides which items to recommend to a given user. Each decision to recommend an item or slate of items has a significant impact on immediate and future user responses, long-term satisfaction or engagement with the system, and possibly valuable exposure for the item provider. The REVEAL workshop will focus on how to optimise this multi-step decision-making process, where a stream of interactions occurs between the user and the system. Deriving reward signals from these interactions, and creating a scalable, performant, and maintainable recommendation model to use for inference is a key challenge for machine learning teams, both in industry and academia. We will discuss the following challenges at the workshop: How can recommendation system models take into account the delayed effects of each recommendation? What are the right ways to reason and plan for longer-term user satisfaction? How can we leverage techniques such as Reinforcement Learning (RL) at scale?","PeriodicalId":443279,"journal":{"name":"Proceedings of the 16th ACM Conference on Recommender Systems","volume":"69 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"REVEAL 2022: Reinforcement Learning-Based Recommender Systems at Scale\",\"authors\":\"Richard Liaw, Paige Bailey, Ying Li, Maria Dimakopoulou, Yves Raimond\",\"doi\":\"10.1145/3523227.3547418\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recommendation systems are increasingly modelled as a sequential decision making process, where the system decides which items to recommend to a given user. Each decision to recommend an item or slate of items has a significant impact on immediate and future user responses, long-term satisfaction or engagement with the system, and possibly valuable exposure for the item provider. The REVEAL workshop will focus on how to optimise this multi-step decision-making process, where a stream of interactions occurs between the user and the system. Deriving reward signals from these interactions, and creating a scalable, performant, and maintainable recommendation model to use for inference is a key challenge for machine learning teams, both in industry and academia. We will discuss the following challenges at the workshop: How can recommendation system models take into account the delayed effects of each recommendation? What are the right ways to reason and plan for longer-term user satisfaction? How can we leverage techniques such as Reinforcement Learning (RL) at scale?\",\"PeriodicalId\":443279,\"journal\":{\"name\":\"Proceedings of the 16th ACM Conference on Recommender Systems\",\"volume\":\"69 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-09-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 16th ACM Conference on Recommender Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3523227.3547418\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 16th ACM Conference on Recommender Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3523227.3547418","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
REVEAL 2022: Reinforcement Learning-Based Recommender Systems at Scale
Recommendation systems are increasingly modelled as a sequential decision making process, where the system decides which items to recommend to a given user. Each decision to recommend an item or slate of items has a significant impact on immediate and future user responses, long-term satisfaction or engagement with the system, and possibly valuable exposure for the item provider. The REVEAL workshop will focus on how to optimise this multi-step decision-making process, where a stream of interactions occurs between the user and the system. Deriving reward signals from these interactions, and creating a scalable, performant, and maintainable recommendation model to use for inference is a key challenge for machine learning teams, both in industry and academia. We will discuss the following challenges at the workshop: How can recommendation system models take into account the delayed effects of each recommendation? What are the right ways to reason and plan for longer-term user satisfaction? How can we leverage techniques such as Reinforcement Learning (RL) at scale?