{"title":"Cost-Aware Active Learning for Feasible Region Identification","authors":"I. Nikova, T. Dhaene, I. Couckuyt","doi":"10.1145/3583133.3596323","DOIUrl":"https://doi.org/10.1145/3583133.3596323","url":null,"abstract":"Design space exploration for engineering design involves identifying feasible designs that satisfy design specifications, often represented by feasibility constraints. To determine whether a design is feasible, an expensive simulation is required. Therefore, it is crucial to find and model the feasible region with as few simulations as possible. Model-based Active learning (AL) is a data-efficient, iterative sampling framework that can be used for design space exploration to identify feasible regions with the least amount of budget spent. A common choice for the budget is the number of (sampling) iterations. This is a good choice when every simulation has an equal cost. However, simulation cost can vary depending on the design parameters and is often unknown. Thus, some regions in the design space are cheaper to evaluate than others. In this work, we investigate if incorporating the unknown cost in the AL strategy leads to better sampling and, eventually, faster identification of the feasible region.","PeriodicalId":422029,"journal":{"name":"Proceedings of the Companion Conference on Genetic and Evolutionary Computation","volume":"93 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130364646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bayesian Optimization For Choice Data","authors":"A. Benavoli, Dario Azzimonti, D. Piga","doi":"10.1145/3583133.3596324","DOIUrl":"https://doi.org/10.1145/3583133.3596324","url":null,"abstract":"In this work we introduce a new framework for multi-objective Bayesian optimisation where the multi-objective functions can only be accessed via choice judgements, such as \"I pick options x1, x2, x3 among this set of five options x1, x2, ..., x5\". The fact that the option x4 is rejected means that there is at least one option among the selected ones x1, x2, x3 that I strictly prefer over x4 (but I do not have to specify which one). We assume that there is a latent vector function u for some dimension d which embeds the options into the real vector space of dimension d, so that the choice set can be represented through a Pareto set of non-dominated options. By placing a Gaussian process prior on u and by using a novel likelihood model for choice data, we derive a surrogate model for the latent vector function. We then propose two novel acquisition functions to solve the multi-objective Bayesian optimisation from choice data.","PeriodicalId":422029,"journal":{"name":"Proceedings of the Companion Conference on Genetic and Evolutionary Computation","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114272013","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Personalized Group Itinerary Recommendation using a Knowledge-based Evolutionary Approach","authors":"Farzaneh Jouyandeh, Pooya Moradian Zadeh","doi":"10.1145/3583133.3596345","DOIUrl":"https://doi.org/10.1145/3583133.3596345","url":null,"abstract":"The problem of recommending a group itinerary is considered to be NP-hard and can be defined as an optimization problem. The goal is to recommend the best series of points of interest (POIs) to a group of people who are visiting a destination based on their preferences and past experiences. This paper proposes an evolutionary approach based on cultural algorithms to address this problem. Our objective is to maximize the group's satisfaction by recommending an itinerary comprised of the optimal series of visiting POIs, considering the interests of all members, total travel time, and visit duration while minimizing the travel costs within their assigned budget. The proposed algorithm uses historical and normative knowledge to create a belief space used later to guide the search direction and decision-making. The belief space is a knowledge repository that tracks the evolution of decisions during the search process. We evaluated the performance of the proposed algorithm on a set of real-world datasets and compared that with state-of-the-art approaches. We also conducted non-parametric tests to analyze the results. Compared with other algorithms, the proposed approach is capable of recommending efficient and satisfactory itineraries to groups with diverse interests.","PeriodicalId":422029,"journal":{"name":"Proceedings of the Companion Conference on Genetic and Evolutionary Computation","volume":"259 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115758886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Romain Orhand, P. Collet, P. Parrend, A. Jeannin-Girardon
{"title":"CRACS: Compaction of Rules in Anticipatory Classifier Systems","authors":"Romain Orhand, P. Collet, P. Parrend, A. Jeannin-Girardon","doi":"10.1145/3583133.3596352","DOIUrl":"https://doi.org/10.1145/3583133.3596352","url":null,"abstract":"Rule Compaction of populations of Learning Classifier Systems (LCS) has always been a topic of interest to get more insights into the discovered underlying patterns from the data or to remove useless classifiers from the populations. However, these techniques have neither been used nor adapted to Anticipatory Learning Classifier Systems (ALCS). ALCS differ from other LCS in that they build models of their environments from which decision policies to solve their learning tasks are learned. We thus propose CRACS (Compaction of Rules in Anticipatory Classifier Systems), a compaction algorithm for ALCS that aims to reduce the size of their environmental models without impairing these models or the ability of these systems to solve their tasks. CRACS relies on filters applied to classifiers and subsumption principles. The capabilities of our compaction algorithm have been studied with three different ALCS on a thorough benchmark of 23 mazes of various levels of environmental uncertainty. The results show that CRACS reduces the size of populations of classifiers while the learned models of environments and the ability of ALCS to solve their tasks are preserved.","PeriodicalId":422029,"journal":{"name":"Proceedings of the Companion Conference on Genetic and Evolutionary Computation","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123159296","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Komarnicki, M. Przewozniczek, H. Kwasnicka, K. Walkowiak
{"title":"Incremental Recursive Ranking Grouping -- A Decomposition Strategy for Additively and Nonadditively Separable Problems","authors":"M. Komarnicki, M. Przewozniczek, H. Kwasnicka, K. Walkowiak","doi":"10.1145/3583133.3595846","DOIUrl":"https://doi.org/10.1145/3583133.3595846","url":null,"abstract":"Many real-world optimization problems may be classified as Large-Scale Global Optimization (LSGO) problems. When these high-dimensional problems are continuous, it was shown effective to embed a decomposition strategy into a Cooperative Co-Evolution (CC) framework. The effectiveness of the method that decomposes a problem into subproblems and optimizes them separately may depend on the decomposition accuracy and cost. Recent decomposition strategy advances focus mainly on Differential Grouping (DG). However, when a considered problem is nonadditively separable, DG-based strategies may report some variables as interacting, although the interaction between them does not exist. Monotonicity checking strategies do not suffer from this disadvantage. However, they suffer from another decomposition inaccuracy - monotonicity checking strategies may miss discovering many existing interactions. Therefore, Incremental Recursive Ranking Grouping (IRRG) is a new proposition that accurately decomposes both additively and nonadditively separable problems. The decomposition cost of IRRG is higher when compared with Recursive DG 3 (RDG3). Since the higher cost was a negligible part of the overall computational budget, optimization results of the considered CC frameworks were affected mainly by the decomposition accuracy.","PeriodicalId":422029,"journal":{"name":"Proceedings of the Companion Conference on Genetic and Evolutionary Computation","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123186655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reducing high-dimensional feature set of hyperspectral measurements for plant phenotype classification","authors":"B. Ruszczak","doi":"10.1145/3583133.3596941","DOIUrl":"https://doi.org/10.1145/3583133.3596941","url":null,"abstract":"Quantifying the drought resistance of potato cultivars plays a key role in precision agriculture, and it may lead to the development of new varieties of plants that are more resistant to harsh environmental conditions. In this work, we tackle the issue of extracting such information in a non-invasive way by acquiring in-field hyperspectral measurements of the potato leaves. Then, we exploit an array of machine learning models to classify plants into three wilting classes based on such data, with those classes corresponding to their drought resistance. We show that evolutionary band selection can dramatically reduce the dimensionality of hyperspectral data while improving classification accuracy. Our experimental study revealed that the evolutionarily-optimized models offer high-quality performance with the impartial rϕ reaching 0.784, accuracy: 0.867, and a 30% improvement over the baseline models which do not benefit from band selection.","PeriodicalId":422029,"journal":{"name":"Proceedings of the Companion Conference on Genetic and Evolutionary Computation","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124901039","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Generative Meta-Learning Robust Quality-Diversity Portfolio","authors":"K. Yuksel","doi":"10.1145/3583133.3590729","DOIUrl":"https://doi.org/10.1145/3583133.3590729","url":null,"abstract":"This paper proposes a novel meta-learning approach to optimize a robust portfolio ensemble. The method uses a deep generative model to generate diverse and high-quality sub-portfolios combined to form the ensemble portfolio. The generative model consists of a convolutional layer, a stateful LSTM module, and a dense network. During training, the model takes a randomly sampled batch of Gaussian noise and outputs a population of solutions, which are then evaluated using the objective function of the problem. The weights of the model are updated using a gradient-based optimizer. The convolutional layer transforms the noise into a desired distribution in latent space, while the LSTM module adds dependence between generations. The dense network decodes the population of solutions. The proposed method balances maximizing the performance of the sub-portfolios with minimizing their maximum correlation, resulting in a robust ensemble portfolio against systematic shocks. The approach was effective in experiments where stochastic rewards were present. Moreover, the results (Fig. 1) demonstrated that the ensemble portfolio obtained by taking the average of the generated sub-portfolio weights was robust and generalized well. The proposed method can be applied to problems where diversity is desired among co-optimized solutions for a robust ensemble. The source-codes and the dataset are in the supplementary material.","PeriodicalId":422029,"journal":{"name":"Proceedings of the Companion Conference on Genetic and Evolutionary Computation","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121765171","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Justin Pauckert, Pieter Debevere, Matthieu Parizy, M. Ayodele
{"title":"Comparing Solution Combination Techniques in Scatter Search for Quadratic Unconstrained Binary Optimization","authors":"Justin Pauckert, Pieter Debevere, Matthieu Parizy, M. Ayodele","doi":"10.1145/3583133.3596319","DOIUrl":"https://doi.org/10.1145/3583133.3596319","url":null,"abstract":"Quadratic Unconstrained Binary Optimization (QUBO) has emerged as a vital unifying model for combinatorial optimization problems, and (meta-)heuristic approaches are commonly used to solve them due to their NP-hard nature. Scatter Search (SS), a population-based metaheuristic framework, is one such method that has shown promising results for QUBO problems. Generating new solutions from more promising ones is a crucial operation in SS. Path Relinking (PR) based SS has been previously used to solve challenging QUBO problems with high-quality solutions. This paper introduces two new variants of the SS algorithm. The first is the (Multi) Uniform Crossover (MUC) based SS while the second is the Univariate Marginal Distribution Algorithm (UMDA) based SS. MUC and UMDA are well-known operators in Genetic Algorithms and Estimation of Distribution Algorithms respectively. When compared to the existing PR based SS, this work shows that more promising results can be achieved when the newly proposed MUC and UMDA-based SS are applied to QUBO formulations of the Quadratic Knapsack Problem (QKP) instances.","PeriodicalId":422029,"journal":{"name":"Proceedings of the Companion Conference on Genetic and Evolutionary Computation","volume":"102 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122025472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Overcoming Deceptive Rewards with Quality-Diversity","authors":"A. Feiden, J. Garcke","doi":"10.1145/3583133.3590741","DOIUrl":"https://doi.org/10.1145/3583133.3590741","url":null,"abstract":"Quality-Diversity offers powerful ideas to create diverse, high-performing populations. Here, we investigate the capabilities these ideas hold to solve exploration-hard single-objective problems, in addition to creating diverse high-performing populations. We find that MAP-Elites is well suited to overcome deceptive reward structures, while an Elites-type approach with an unstructured, distance based container and extinction events can even outperform it. Furthermore, we analyse how the QD score, the standard evaluation of MAP-Elites type algorithms, is not well suited to predict the success of a configuration in solving a maze. This shows that the exploration capacity is an entirely different dimension in which QD algorithms can be utilized, evaluated, and improved on. It is a dimension that does not currently seem to be covered, implicitly or explicitly, by the current advances in the field.","PeriodicalId":422029,"journal":{"name":"Proceedings of the Companion Conference on Genetic and Evolutionary Computation","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122050191","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fast generation of centroids for MAP-Elites","authors":"Jean-Baptiste Mouret","doi":"10.1145/3583133.3590726","DOIUrl":"https://doi.org/10.1145/3583133.3590726","url":null,"abstract":"The use of MAP-Elites in high-dimensional behavioral spaces requires a scalable method for dividing the space into regions of equal volume. So far, the recommended approach to generate these regions has been the Centroidal Voronoi Tesselation (CVT), but this algorithm has a significant computational cost (typically a few minutes for more than 50 dimensions). In this paper, we investigate alternative approaches to generate regions of equal volumes for MAP-Elites. In particular, we experiment with generating region centroids with low-discrepancy sequences (Sobol, Halton), pseudorandom numbers, and a simple blue noise generator. Our results show that, for spaces with 100 dimensions, most methods perform similarly, including pseudo-random numbers. For spaces with dimensions between 5 and 50, a CVT generates significantly better centroids. In lower dimensions (1--5), a scrambled Sobol sequence generates well-spread centroids in a few milliseconds.","PeriodicalId":422029,"journal":{"name":"Proceedings of the Companion Conference on Genetic and Evolutionary Computation","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121412508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}