Huan Zhao , Zhiyuan Gong , Keyao Gan , Yujie Gan , Haonan Xing , Shekun Wang
{"title":"用于高维代用建模和优化的有监督内核主成分分析-多项式混沌-克里金法","authors":"Huan Zhao , Zhiyuan Gong , Keyao Gan , Yujie Gan , Haonan Xing , Shekun Wang","doi":"10.1016/j.knosys.2024.112617","DOIUrl":null,"url":null,"abstract":"<div><div>Surrogate-based optimization (SBO) approach is becoming more and more popular in the expensive aerodynamic design of aircraft. However, with increasing number of design variables required for parameterizing a complex shape, SBO is suffering from the serious difficulty of the curse of dimensionality. To ameliorate this issue, a supervised nonlinear dimensionality-reduction surrogate modelling method was proposed. Such a method combines the supervised kernel principal component analysis (SKPCA) and polynomial chaos-Kriging (PCK) techniques into the jointly surrogate modelling process and adaptively establishes the accurate mapping from the high-dimensional inputs to the output of the system. This SKPCA-PCK method, which fully considers the effect of inputs on outputs and adaptively trains these hyper-parameters in the surrogate modelling process, escapes from the low prediction accuracy and instability of the surrogate model in conjunction with current linear or unsupervised dimensionality-reduction methods. Further, an efficient SKPCA-PCK-based global optimization method for high-dimensional aerodynamic design was developed. The performance of the proposed method is examined by investigating two numerical examples, the transonic RAE2822 airfoil and the wing of the NASA Common Research Model. Results demonstrate that the proposed SKPCA-PCK method significantly improves the modelling efficiency and accuracy compared to the unsupervised linear PCA-Kriging method. More importantly, the proposed SKPCA-PCK-based optimization method provides better performance and an appreciably higher optimization efficiency for expensive single-point and robust aerodynamic design involving high-dimensional design variables compared to the Kriging-based optimization method. These results provide further evidence that the proposed method provides a promising approach for mitigating the curse of dimensionality in SBO.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":null,"pages":null},"PeriodicalIF":7.2000,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Supervised kernel principal component analysis-polynomial chaos-Kriging for high-dimensional surrogate modelling and optimization\",\"authors\":\"Huan Zhao , Zhiyuan Gong , Keyao Gan , Yujie Gan , Haonan Xing , Shekun Wang\",\"doi\":\"10.1016/j.knosys.2024.112617\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Surrogate-based optimization (SBO) approach is becoming more and more popular in the expensive aerodynamic design of aircraft. However, with increasing number of design variables required for parameterizing a complex shape, SBO is suffering from the serious difficulty of the curse of dimensionality. To ameliorate this issue, a supervised nonlinear dimensionality-reduction surrogate modelling method was proposed. Such a method combines the supervised kernel principal component analysis (SKPCA) and polynomial chaos-Kriging (PCK) techniques into the jointly surrogate modelling process and adaptively establishes the accurate mapping from the high-dimensional inputs to the output of the system. This SKPCA-PCK method, which fully considers the effect of inputs on outputs and adaptively trains these hyper-parameters in the surrogate modelling process, escapes from the low prediction accuracy and instability of the surrogate model in conjunction with current linear or unsupervised dimensionality-reduction methods. Further, an efficient SKPCA-PCK-based global optimization method for high-dimensional aerodynamic design was developed. The performance of the proposed method is examined by investigating two numerical examples, the transonic RAE2822 airfoil and the wing of the NASA Common Research Model. Results demonstrate that the proposed SKPCA-PCK method significantly improves the modelling efficiency and accuracy compared to the unsupervised linear PCA-Kriging method. More importantly, the proposed SKPCA-PCK-based optimization method provides better performance and an appreciably higher optimization efficiency for expensive single-point and robust aerodynamic design involving high-dimensional design variables compared to the Kriging-based optimization method. These results provide further evidence that the proposed method provides a promising approach for mitigating the curse of dimensionality in SBO.</div></div>\",\"PeriodicalId\":49939,\"journal\":{\"name\":\"Knowledge-Based Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2024-10-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Knowledge-Based Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0950705124012516\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705124012516","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Supervised kernel principal component analysis-polynomial chaos-Kriging for high-dimensional surrogate modelling and optimization
Surrogate-based optimization (SBO) approach is becoming more and more popular in the expensive aerodynamic design of aircraft. However, with increasing number of design variables required for parameterizing a complex shape, SBO is suffering from the serious difficulty of the curse of dimensionality. To ameliorate this issue, a supervised nonlinear dimensionality-reduction surrogate modelling method was proposed. Such a method combines the supervised kernel principal component analysis (SKPCA) and polynomial chaos-Kriging (PCK) techniques into the jointly surrogate modelling process and adaptively establishes the accurate mapping from the high-dimensional inputs to the output of the system. This SKPCA-PCK method, which fully considers the effect of inputs on outputs and adaptively trains these hyper-parameters in the surrogate modelling process, escapes from the low prediction accuracy and instability of the surrogate model in conjunction with current linear or unsupervised dimensionality-reduction methods. Further, an efficient SKPCA-PCK-based global optimization method for high-dimensional aerodynamic design was developed. The performance of the proposed method is examined by investigating two numerical examples, the transonic RAE2822 airfoil and the wing of the NASA Common Research Model. Results demonstrate that the proposed SKPCA-PCK method significantly improves the modelling efficiency and accuracy compared to the unsupervised linear PCA-Kriging method. More importantly, the proposed SKPCA-PCK-based optimization method provides better performance and an appreciably higher optimization efficiency for expensive single-point and robust aerodynamic design involving high-dimensional design variables compared to the Kriging-based optimization method. These results provide further evidence that the proposed method provides a promising approach for mitigating the curse of dimensionality in SBO.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.