Jonas Nüßlein, Steffen Illium, Robert Müller, Thomas Gabor, Claudia Linnhoff-Popien
{"title":"Case-Based Inverse Reinforcement Learning Using Temporal Coherence","authors":"Jonas Nüßlein, Steffen Illium, Robert Müller, Thomas Gabor, Claudia Linnhoff-Popien","doi":"10.48550/arXiv.2206.05827","DOIUrl":"https://doi.org/10.48550/arXiv.2206.05827","url":null,"abstract":"Providing expert trajectories in the context of Imitation Learning is often expensive and time-consuming. The goal must therefore be to create algorithms which require as little expert data as possible. In this paper we present an algorithm that imitates the higher-level strategy of the expert rather than just imitating the expert on action level, which we hypothesize requires less expert data and makes training more stable. As a prior, we assume that the higher-level strategy is to reach an unknown target state area, which we hypothesize is a valid prior for many domains in Reinforcement Learning. The target state area is unknown, but since the expert has demonstrated how to reach it, the agent tries to reach states similar to the expert. Building on the idea of Temporal Coherence, our algorithm trains a neural network to predict whether two states are similar, in the sense that they may occur close in time. During inference, the agent compares its current state with expert states from a Case Base for similarity. The results show that our approach can still learn a near-optimal policy in settings with very little expert data, where algorithms that try to imitate the expert at the action level can no longer do so.","PeriodicalId":239937,"journal":{"name":"International Conference on Case-Based Reasoning","volume":"160 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114497437","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Temraz, Eoin M. Kenny, E. Ruelle, L. Shalloo, B. Smyth, Markt. Keane
{"title":"Handling Climate Change Using Counterfactuals: Using Counterfactuals in Data Augmentation to Predict Crop Growth in an Uncertain Climate Future","authors":"M. Temraz, Eoin M. Kenny, E. Ruelle, L. Shalloo, B. Smyth, Markt. Keane","doi":"10.1007/978-3-030-86957-1_15","DOIUrl":"https://doi.org/10.1007/978-3-030-86957-1_15","url":null,"abstract":"","PeriodicalId":239937,"journal":{"name":"International Conference on Case-Based Reasoning","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123607604","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Learning to Compare with Few Data for Personalised Human Activity Recognition","authors":"N. Wiratunga, A. Wijekoon, Kay Cooper","doi":"10.1007/978-3-030-58342-2_1","DOIUrl":"https://doi.org/10.1007/978-3-030-58342-2_1","url":null,"abstract":"","PeriodicalId":239937,"journal":{"name":"International Conference on Case-Based Reasoning","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-08-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124743335","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
V. Eisenstadt, C. Langenhan, K. Althoff, A. Dengel
{"title":"Improved and Visually Enhanced Case-Based Retrieval of Room Configurations for Assistance in Architectural Design Education","authors":"V. Eisenstadt, C. Langenhan, K. Althoff, A. Dengel","doi":"10.1007/978-3-030-58342-2_14","DOIUrl":"https://doi.org/10.1007/978-3-030-58342-2_14","url":null,"abstract":"","PeriodicalId":239937,"journal":{"name":"International Conference on Case-Based Reasoning","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115712023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Divya Srivastava, D. Lofaro, Tristan K. Schuler, D. Sofge, D. Aha
{"title":"Case-Based Gesture Interface for Multiagent Formation Control","authors":"Divya Srivastava, D. Lofaro, Tristan K. Schuler, D. Sofge, D. Aha","doi":"10.1007/978-3-030-58342-2_19","DOIUrl":"https://doi.org/10.1007/978-3-030-58342-2_19","url":null,"abstract":"","PeriodicalId":239937,"journal":{"name":"International Conference on Case-Based Reasoning","volume":"97 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133401871","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. A. Recio-García, B. Díaz-Agudo, Victor Pino-Castilla
{"title":"CBR-LIME: A Case-Based Reasoning Approach to Provide Specific Local Interpretable Model-Agnostic Explanations","authors":"J. A. Recio-García, B. Díaz-Agudo, Victor Pino-Castilla","doi":"10.1007/978-3-030-58342-2_12","DOIUrl":"https://doi.org/10.1007/978-3-030-58342-2_12","url":null,"abstract":"","PeriodicalId":239937,"journal":{"name":"International Conference on Case-Based Reasoning","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114469984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Good Counterfactuals and Where to Find Them: A Case-Based Technique for Generating Counterfactuals for Explainable AI (XAI)","authors":"","doi":"10.1007/978-3-030-58342-2_11","DOIUrl":"https://doi.org/10.1007/978-3-030-58342-2_11","url":null,"abstract":"","PeriodicalId":239937,"journal":{"name":"International Conference on Case-Based Reasoning","volume":"54 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-05-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129444145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Going Further with Cases: Using Case-Based Reasoning to Recommend Pacing Strategies for Ultra-Marathon Runners","authors":"Cathal McConnell, B. Smyth","doi":"10.1007/978-3-030-29249-2_24","DOIUrl":"https://doi.org/10.1007/978-3-030-29249-2_24","url":null,"abstract":"","PeriodicalId":239937,"journal":{"name":"International Conference on Case-Based Reasoning","volume":"203 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123046288","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. L. Jorro-Aragoneses, Marta Caro-Martínez, J. A. Recio-García, B. Díaz-Agudo, Guillermo Jiménez-Díaz
{"title":"Personalized Case-Based Explanation of Matrix Factorization Recommendations","authors":"J. L. Jorro-Aragoneses, Marta Caro-Martínez, J. A. Recio-García, B. Díaz-Agudo, Guillermo Jiménez-Díaz","doi":"10.1007/978-3-030-29249-2_10","DOIUrl":"https://doi.org/10.1007/978-3-030-29249-2_10","url":null,"abstract":"","PeriodicalId":239937,"journal":{"name":"International Conference on Case-Based Reasoning","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127163650","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improving Analogical Extrapolation Using Case Pair Competence","authors":"Jean Lieber, E. Nauer, H. Prade","doi":"10.1007/978-3-030-29249-2_17","DOIUrl":"https://doi.org/10.1007/978-3-030-29249-2_17","url":null,"abstract":"","PeriodicalId":239937,"journal":{"name":"International Conference on Case-Based Reasoning","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124909094","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}