Foundations and Trends in Machine Learning最新文献

Model-based Reinforcement Learning: A Survey 基于模型的强化学习:综述

Foundations and Trends in Machine Learning Pub Date : 2023-01-01 DOI: 10.1561/2200000086

Thomas M. Moerland, Joost Broekens, Aske Plaat, Catholijn M. Jonker

{"title":"Model-based Reinforcement Learning: A Survey","authors":"Thomas M. Moerland, Joost Broekens, Aske Plaat, Catholijn M. Jonker","doi":"10.1561/2200000086","DOIUrl":"https://doi.org/10.1561/2200000086","url":null,"abstract":"Sequential decision making, commonly formalized as Markov Decision Process (MDP) optimization, is an important challenge in artificial intelligence. Two key approaches to this problem are reinforcement learning (RL) and planning. This monograph surveys an integration of both fields, better known as model-based reinforcement learning. Model-based RL has two main steps: dynamics model learning and planning-learning integration. In this comprehensive survey of the topic, the authors first cover dynamics model learning, including challenges such as dealing with stochasticity, uncertainty, partial observability, and temporal abstraction. They then present a systematic categorization of planning-learning integration, including aspects such as: where to start planning, what budgets to allocate to planning and real data collection, how to plan, and how to integrate planning in the learning and acting loop. In conclusion the authors discuss implicit model-based RL as an end-to-end alternative for model learning and planning, and cover the potential benefits of model-based RL. Along the way, the authors draw connections to several related RL fields, including hierarchical RL and transfer learning. This monograph contains a broad conceptual overview of the combination of planning and learning for Markov Decision Process optimization. It provides a clear and complete introduction to the topic for students and researchers alike.","PeriodicalId":47667,"journal":{"name":"Foundations and Trends in Machine Learning","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135799442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 84

Probabilistic Learning 概率学习

IF 32.8

Foundations and Trends in Machine Learning Pub Date : 2020-12-01 DOI: 10.1007/978-3-030-65900-4_6

T. Jo

引用次数: 0

Data Encoding 数据编码

IF 32.8

Foundations and Trends in Machine Learning Pub Date : 2020-12-01 DOI: 10.1007/978-3-030-65900-4_3

T. Jo

引用次数: 1

Support Vector Machine 支持向量机

IF 32.8

Foundations and Trends in Machine Learning Pub Date : 2020-12-01 DOI: 10.1007/978-3-030-65900-4_8

T. Jo

引用次数: 3

Numerical Vectors 数值向量

IF 32.8

Foundations and Trends in Machine Learning Pub Date : 2020-12-01 DOI: 10.1007/978-3-030-65900-4_2

T. Jo

引用次数: 0

Advanced Clustering 先进的集群

IF 32.8

Foundations and Trends in Machine Learning Pub Date : 2020-12-01 DOI: 10.1007/978-3-030-65900-4_12

T. Jo

引用次数: 2

Temporal Learning 时间学习

IF 32.8

Foundations and Trends in Machine Learning Pub Date : 2020-12-01 DOI: 10.1007/978-3-030-65900-4_15

T. Jo

引用次数: 3

Semi-supervised Learning Semi-supervised学习

IF 32.8

Foundations and Trends in Machine Learning Pub Date : 2020-12-01 DOI: 10.1007/978-3-030-65900-4_14

T. Jo

引用次数: 0

Reinforcement Learning 强化学习

IF 32.8

Foundations and Trends in Machine Learning Pub Date : 2020-12-01 DOI: 10.1007/978-3-030-65900-4_16

T. Jo

引用次数: 1

How Good Is Your Scientific Data Generative Model? 你的科学数据生成模型有多好?

IF 32.8

Foundations and Trends in Machine Learning Pub Date : 2020-11-01 DOI: 10.1109/MLHPCAI4S51975.2020.00018

Yuxin Yang, Ben Gremillion, Xitong Zhang, Youzuo Lin, B. Wohlberg, Qiang Guan

引用次数: 1