{"title":"通过随机分组和稀疏高斯建模实现中等规模问题的代理辅助多目标进化优化","authors":"Haofeng Wu;Yaochu Jin;Kailai Gao;Jinliang Ding;Ran Cheng","doi":"10.1109/TETCI.2024.3372378","DOIUrl":null,"url":null,"abstract":"Gaussian processes (GPs) are widely employed in surrogate-assisted evolutionary algorithms (SAEAs) because they can estimate the level of uncertainty in their predictions. However, the computational complexity of GPs grows cubically with the number of training samples, the time required for constructing a GP becomes excessively long. Additionally, in SAEAs, the GP is updated using the new data sampled in each round, which significantly impairs its efficiency in addressing medium-scale optimization problems. This issue is exacerbated in multi-objective scenarios where multiple GP models are needed. To address this challenge, we propose a fast SAEA using sparse GPs for medium-scale expensive multi-objective optimization problems. We construct a sparse GP for each objective on randomly selected sub-decision spaces and optimize a multi-objective acquisition function using a multi-objective evolutionary algorithm. The resulting population is combined with the previously evaluated solutions, and k-means is used for clustering to obtain candidate solutions. Before real function evaluations, the candidate solutions in the subspace are completed with the values of the knee point in the archive. Experimental results on three benchmark test suites up to 80 decision variables demonstrate the algorithm's computational efficiency and competitive performance compared to state-of-the-art methods. Additionally, we verify its performance on a real-world optimization problem.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":"8 5","pages":"3263-3278"},"PeriodicalIF":5.3000,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Surrogate-Assisted Evolutionary Multi-Objective Optimization of Medium-Scale Problems by Random Grouping and Sparse Gaussian Modeling\",\"authors\":\"Haofeng Wu;Yaochu Jin;Kailai Gao;Jinliang Ding;Ran Cheng\",\"doi\":\"10.1109/TETCI.2024.3372378\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Gaussian processes (GPs) are widely employed in surrogate-assisted evolutionary algorithms (SAEAs) because they can estimate the level of uncertainty in their predictions. However, the computational complexity of GPs grows cubically with the number of training samples, the time required for constructing a GP becomes excessively long. Additionally, in SAEAs, the GP is updated using the new data sampled in each round, which significantly impairs its efficiency in addressing medium-scale optimization problems. This issue is exacerbated in multi-objective scenarios where multiple GP models are needed. To address this challenge, we propose a fast SAEA using sparse GPs for medium-scale expensive multi-objective optimization problems. We construct a sparse GP for each objective on randomly selected sub-decision spaces and optimize a multi-objective acquisition function using a multi-objective evolutionary algorithm. The resulting population is combined with the previously evaluated solutions, and k-means is used for clustering to obtain candidate solutions. Before real function evaluations, the candidate solutions in the subspace are completed with the values of the knee point in the archive. Experimental results on three benchmark test suites up to 80 decision variables demonstrate the algorithm's computational efficiency and competitive performance compared to state-of-the-art methods. Additionally, we verify its performance on a real-world optimization problem.\",\"PeriodicalId\":13135,\"journal\":{\"name\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"volume\":\"8 5\",\"pages\":\"3263-3278\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-03-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10478742/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Emerging Topics in Computational Intelligence","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10478742/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
摘要
高斯过程(GPs)可以估计预测结果的不确定性,因此被广泛应用于代理辅助进化算法(SAEAs)中。然而,GPs 的计算复杂度随着训练样本数量的增加而呈立方增长,构建 GPs 所需的时间变得过长。此外,在 SAEAs 中,GP 要使用每轮采样的新数据进行更新,这大大降低了它处理中等规模优化问题的效率。在需要多个 GP 模型的多目标场景中,这一问题更加严重。为了应对这一挑战,我们提出了一种使用稀疏 GP 的快速 SAEA,用于解决中等规模的昂贵多目标优化问题。我们在随机选择的子决策空间上为每个目标构建稀疏 GP,并使用多目标进化算法优化多目标获取函数。生成的群体与之前评估的解决方案相结合,并使用 k-means 进行聚类,以获得候选解决方案。在实际函数评估之前,将子空间中的候选解与档案中的膝点值一起完成。在多达 80 个决策变量的三个基准测试套件上的实验结果表明,与最先进的方法相比,该算法的计算效率和性能极具竞争力。此外,我们还验证了该算法在实际优化问题上的性能。
Surrogate-Assisted Evolutionary Multi-Objective Optimization of Medium-Scale Problems by Random Grouping and Sparse Gaussian Modeling
Gaussian processes (GPs) are widely employed in surrogate-assisted evolutionary algorithms (SAEAs) because they can estimate the level of uncertainty in their predictions. However, the computational complexity of GPs grows cubically with the number of training samples, the time required for constructing a GP becomes excessively long. Additionally, in SAEAs, the GP is updated using the new data sampled in each round, which significantly impairs its efficiency in addressing medium-scale optimization problems. This issue is exacerbated in multi-objective scenarios where multiple GP models are needed. To address this challenge, we propose a fast SAEA using sparse GPs for medium-scale expensive multi-objective optimization problems. We construct a sparse GP for each objective on randomly selected sub-decision spaces and optimize a multi-objective acquisition function using a multi-objective evolutionary algorithm. The resulting population is combined with the previously evaluated solutions, and k-means is used for clustering to obtain candidate solutions. Before real function evaluations, the candidate solutions in the subspace are completed with the values of the knee point in the archive. Experimental results on three benchmark test suites up to 80 decision variables demonstrate the algorithm's computational efficiency and competitive performance compared to state-of-the-art methods. Additionally, we verify its performance on a real-world optimization problem.
期刊介绍:
The IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI) publishes original articles on emerging aspects of computational intelligence, including theory, applications, and surveys.
TETCI is an electronics only publication. TETCI publishes six issues per year.
Authors are encouraged to submit manuscripts in any emerging topic in computational intelligence, especially nature-inspired computing topics not covered by other IEEE Computational Intelligence Society journals. A few such illustrative examples are glial cell networks, computational neuroscience, Brain Computer Interface, ambient intelligence, non-fuzzy computing with words, artificial life, cultural learning, artificial endocrine networks, social reasoning, artificial hormone networks, computational intelligence for the IoT and Smart-X technologies.