TensorCRO: A TensorFlow‐based implementation of a multi‐method ensemble for optimization

IF 3 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Expert Systems Pub Date : 2024-09-06 DOI:10.1111/exsy.13713
A. Palomo‐Alonso, V. G. Costa, L. M. Moreno‐Saavedra, E. Lorente‐Ramos, J. Pérez‐Aracil, C. E. Pedreira, S. Salcedo‐Sanz
{"title":"TensorCRO: A TensorFlow‐based implementation of a multi‐method ensemble for optimization","authors":"A. Palomo‐Alonso, V. G. Costa, L. M. Moreno‐Saavedra, E. Lorente‐Ramos, J. Pérez‐Aracil, C. E. Pedreira, S. Salcedo‐Sanz","doi":"10.1111/exsy.13713","DOIUrl":null,"url":null,"abstract":"This paper presents a novel implementation of the Coral Reef Optimization with Substrate Layers (CRO‐SL) algorithm. Our approach, which we call TensorCRO, takes advantage of the TensorFlow framework to represent CRO‐SL as a series of tensor operations, allowing it to run on GPU and search for solutions in a faster and more efficient way. We evaluate the performance of the proposed implementation across a wide range of benchmark functions commonly used in optimization research (such as the Rastrigin, Rosenbrock, Ackley, and Griewank functions), and we show that GPU execution leads to considerable speedups when compared to its CPU counterpart. Then, when comparing TensorCRO to other state‐of‐the‐art optimization algorithms (such as the Genetic Algorithm, Simulated Annealing, and Particle Swarm Optimization), the results show that TensorCRO can achieve better convergence rates and solutions than other algorithms within a fixed execution time, given that the fitness functions are also implemented on TensorFlow. Furthermore, we also evaluate the proposed approach in a real‐world problem of optimizing power production in wind farms by selecting the locations of turbines; in every evaluated scenario, TensorCRO outperformed the other meta‐heuristics and achieved solutions close to the best known in the literature. Overall, our implementation of the CRO‐SL algorithm in TensorFlow GPU provides a new, fast, and efficient approach to solving optimization problems, and we believe that the proposed implementation has significant potential to be applied in various domains, such as engineering, finance, and machine learning, where optimization is often used to solve complex problems. Furthermore, we propose that this implementation can be used to optimize models that cannot propagate an error gradient, which is an excellent choice for non‐gradient‐based optimizers.","PeriodicalId":51053,"journal":{"name":"Expert Systems","volume":null,"pages":null},"PeriodicalIF":3.0000,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1111/exsy.13713","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

This paper presents a novel implementation of the Coral Reef Optimization with Substrate Layers (CRO‐SL) algorithm. Our approach, which we call TensorCRO, takes advantage of the TensorFlow framework to represent CRO‐SL as a series of tensor operations, allowing it to run on GPU and search for solutions in a faster and more efficient way. We evaluate the performance of the proposed implementation across a wide range of benchmark functions commonly used in optimization research (such as the Rastrigin, Rosenbrock, Ackley, and Griewank functions), and we show that GPU execution leads to considerable speedups when compared to its CPU counterpart. Then, when comparing TensorCRO to other state‐of‐the‐art optimization algorithms (such as the Genetic Algorithm, Simulated Annealing, and Particle Swarm Optimization), the results show that TensorCRO can achieve better convergence rates and solutions than other algorithms within a fixed execution time, given that the fitness functions are also implemented on TensorFlow. Furthermore, we also evaluate the proposed approach in a real‐world problem of optimizing power production in wind farms by selecting the locations of turbines; in every evaluated scenario, TensorCRO outperformed the other meta‐heuristics and achieved solutions close to the best known in the literature. Overall, our implementation of the CRO‐SL algorithm in TensorFlow GPU provides a new, fast, and efficient approach to solving optimization problems, and we believe that the proposed implementation has significant potential to be applied in various domains, such as engineering, finance, and machine learning, where optimization is often used to solve complex problems. Furthermore, we propose that this implementation can be used to optimize models that cannot propagate an error gradient, which is an excellent choice for non‐gradient‐based optimizers.
TensorCRO:基于 TensorFlow 的多方法优化组合实施方案
本文介绍了珊瑚礁底层优化算法(CRO-SL)的新型实现方法。我们将这种方法称为 TensorCRO,它利用 TensorFlow 框架将 CRO-SL 表述为一系列张量运算,使其能够在 GPU 上运行,并以更快、更高效的方式搜索解决方案。我们在优化研究中常用的各种基准函数(如 Rastrigin、Rosenbrock、Ackley 和 Griewank 函数)上评估了所建议的实现的性能,结果表明,与 CPU 相比,GPU 的执行速度大大提高。然后,在将 TensorCRO 与其他最先进的优化算法(如遗传算法、模拟退火和粒子群优化)进行比较时,结果表明 TensorCRO 可以在固定的执行时间内实现比其他算法更好的收敛速度和解决方案,因为适配函数也是在 TensorFlow 上实现的。此外,我们还在通过选择涡轮机位置来优化风力发电场发电量的实际问题中对所提出的方法进行了评估;在每个评估场景中,TensorCRO 的表现都优于其他元启发式算法,并获得了接近文献中已知最佳的解决方案。总之,我们在 TensorFlow GPU 中实现的 CRO-SL 算法为解决优化问题提供了一种全新、快速、高效的方法,我们相信所提出的实现方法在工程、金融和机器学习等经常使用优化方法解决复杂问题的各个领域都有巨大的应用潜力。此外,我们还提出,这种实现方法可用于优化无法传播误差梯度的模型,这对于基于非梯度的优化器来说是一个极佳的选择。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Expert Systems
Expert Systems 工程技术-计算机:理论方法
CiteScore
7.40
自引率
6.10%
发文量
266
审稿时长
24 months
期刊介绍: Expert Systems: The Journal of Knowledge Engineering publishes papers dealing with all aspects of knowledge engineering, including individual methods and techniques in knowledge acquisition and representation, and their application in the construction of systems – including expert systems – based thereon. Detailed scientific evaluation is an essential part of any paper. As well as traditional application areas, such as Software and Requirements Engineering, Human-Computer Interaction, and Artificial Intelligence, we are aiming at the new and growing markets for these technologies, such as Business, Economy, Market Research, and Medical and Health Care. The shift towards this new focus will be marked by a series of special issues covering hot and emergent topics.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信