通过随机分组和稀疏高斯建模实现中等规模问题的代理辅助多目标进化优化

IF 5.3 3区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Haofeng Wu;Yaochu Jin;Kailai Gao;Jinliang Ding;Ran Cheng
{"title":"通过随机分组和稀疏高斯建模实现中等规模问题的代理辅助多目标进化优化","authors":"Haofeng Wu;Yaochu Jin;Kailai Gao;Jinliang Ding;Ran Cheng","doi":"10.1109/TETCI.2024.3372378","DOIUrl":null,"url":null,"abstract":"Gaussian processes (GPs) are widely employed in surrogate-assisted evolutionary algorithms (SAEAs) because they can estimate the level of uncertainty in their predictions. However, the computational complexity of GPs grows cubically with the number of training samples, the time required for constructing a GP becomes excessively long. Additionally, in SAEAs, the GP is updated using the new data sampled in each round, which significantly impairs its efficiency in addressing medium-scale optimization problems. This issue is exacerbated in multi-objective scenarios where multiple GP models are needed. To address this challenge, we propose a fast SAEA using sparse GPs for medium-scale expensive multi-objective optimization problems. We construct a sparse GP for each objective on randomly selected sub-decision spaces and optimize a multi-objective acquisition function using a multi-objective evolutionary algorithm. The resulting population is combined with the previously evaluated solutions, and k-means is used for clustering to obtain candidate solutions. Before real function evaluations, the candidate solutions in the subspace are completed with the values of the knee point in the archive. Experimental results on three benchmark test suites up to 80 decision variables demonstrate the algorithm's computational efficiency and competitive performance compared to state-of-the-art methods. Additionally, we verify its performance on a real-world optimization problem.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":"8 5","pages":"3263-3278"},"PeriodicalIF":5.3000,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Surrogate-Assisted Evolutionary Multi-Objective Optimization of Medium-Scale Problems by Random Grouping and Sparse Gaussian Modeling\",\"authors\":\"Haofeng Wu;Yaochu Jin;Kailai Gao;Jinliang Ding;Ran Cheng\",\"doi\":\"10.1109/TETCI.2024.3372378\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Gaussian processes (GPs) are widely employed in surrogate-assisted evolutionary algorithms (SAEAs) because they can estimate the level of uncertainty in their predictions. However, the computational complexity of GPs grows cubically with the number of training samples, the time required for constructing a GP becomes excessively long. Additionally, in SAEAs, the GP is updated using the new data sampled in each round, which significantly impairs its efficiency in addressing medium-scale optimization problems. This issue is exacerbated in multi-objective scenarios where multiple GP models are needed. To address this challenge, we propose a fast SAEA using sparse GPs for medium-scale expensive multi-objective optimization problems. We construct a sparse GP for each objective on randomly selected sub-decision spaces and optimize a multi-objective acquisition function using a multi-objective evolutionary algorithm. The resulting population is combined with the previously evaluated solutions, and k-means is used for clustering to obtain candidate solutions. Before real function evaluations, the candidate solutions in the subspace are completed with the values of the knee point in the archive. Experimental results on three benchmark test suites up to 80 decision variables demonstrate the algorithm's computational efficiency and competitive performance compared to state-of-the-art methods. Additionally, we verify its performance on a real-world optimization problem.\",\"PeriodicalId\":13135,\"journal\":{\"name\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"volume\":\"8 5\",\"pages\":\"3263-3278\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-03-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10478742/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Emerging Topics in Computational Intelligence","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10478742/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

高斯过程(GPs)可以估计预测结果的不确定性,因此被广泛应用于代理辅助进化算法(SAEAs)中。然而,GPs 的计算复杂度随着训练样本数量的增加而呈立方增长,构建 GPs 所需的时间变得过长。此外,在 SAEAs 中,GP 要使用每轮采样的新数据进行更新,这大大降低了它处理中等规模优化问题的效率。在需要多个 GP 模型的多目标场景中,这一问题更加严重。为了应对这一挑战,我们提出了一种使用稀疏 GP 的快速 SAEA,用于解决中等规模的昂贵多目标优化问题。我们在随机选择的子决策空间上为每个目标构建稀疏 GP,并使用多目标进化算法优化多目标获取函数。生成的群体与之前评估的解决方案相结合,并使用 k-means 进行聚类,以获得候选解决方案。在实际函数评估之前,将子空间中的候选解与档案中的膝点值一起完成。在多达 80 个决策变量的三个基准测试套件上的实验结果表明,与最先进的方法相比,该算法的计算效率和性能极具竞争力。此外,我们还验证了该算法在实际优化问题上的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Surrogate-Assisted Evolutionary Multi-Objective Optimization of Medium-Scale Problems by Random Grouping and Sparse Gaussian Modeling
Gaussian processes (GPs) are widely employed in surrogate-assisted evolutionary algorithms (SAEAs) because they can estimate the level of uncertainty in their predictions. However, the computational complexity of GPs grows cubically with the number of training samples, the time required for constructing a GP becomes excessively long. Additionally, in SAEAs, the GP is updated using the new data sampled in each round, which significantly impairs its efficiency in addressing medium-scale optimization problems. This issue is exacerbated in multi-objective scenarios where multiple GP models are needed. To address this challenge, we propose a fast SAEA using sparse GPs for medium-scale expensive multi-objective optimization problems. We construct a sparse GP for each objective on randomly selected sub-decision spaces and optimize a multi-objective acquisition function using a multi-objective evolutionary algorithm. The resulting population is combined with the previously evaluated solutions, and k-means is used for clustering to obtain candidate solutions. Before real function evaluations, the candidate solutions in the subspace are completed with the values of the knee point in the archive. Experimental results on three benchmark test suites up to 80 decision variables demonstrate the algorithm's computational efficiency and competitive performance compared to state-of-the-art methods. Additionally, we verify its performance on a real-world optimization problem.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
10.30
自引率
7.50%
发文量
147
期刊介绍: The IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI) publishes original articles on emerging aspects of computational intelligence, including theory, applications, and surveys. TETCI is an electronics only publication. TETCI publishes six issues per year. Authors are encouraged to submit manuscripts in any emerging topic in computational intelligence, especially nature-inspired computing topics not covered by other IEEE Computational Intelligence Society journals. A few such illustrative examples are glial cell networks, computational neuroscience, Brain Computer Interface, ambient intelligence, non-fuzzy computing with words, artificial life, cultural learning, artificial endocrine networks, social reasoning, artificial hormone networks, computational intelligence for the IoT and Smart-X technologies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信