Hwisang Jo, Byeong-uk Song, Joon-Yong Huh, Seungkyu Lee, Ikjin Lee
{"title":"改进深度神经网络结构,用于训练具有非通用输入变量的多保真数据","authors":"Hwisang Jo, Byeong-uk Song, Joon-Yong Huh, Seungkyu Lee, Ikjin Lee","doi":"10.1115/1.4064782","DOIUrl":null,"url":null,"abstract":"\n Multi-fidelity surrogate (MFS) modeling technology, which efficiently constructs surrogate models using low-fidelity (LF) and high-fidelity (HF) data, has been studied to enhance the predictive capability of engineering performances. In addition, several neural network (NN) structures for MFS modeling have been introduced, benefiting from recent developments in deep learning research. However, existing multi-fidelity (MF) NNs have been developed assuming identical sets of input variables for LF and HF data, a condition that is often not met in practical engineering systems. Therefore, this study proposes a new structure of composite NN designed for MF data with different input variables. The proposed network structure includes an input mapping network that connects the LF and HF data's input variables. Even when the physical relationship between these variables is unknown, the input mapping network can be concurrently trained during the process of training the whole network model. Customized loss functions and activation variables are suggested in this study to facilitate forward and backward propagation for the proposed NN structures when training MF data with different inputs. The effectiveness of the proposed method, in terms of prediction accuracy, is demonstrated through mathematical examples and practical engineering problems related to tire performances. The results confirm that the proposed method offers better accuracy than existing surrogate models in most problems. Moreover, the proposed method proves advantageous for surrogate modeling of nonlinear or discrete functions, a characteristic feature of NN-based methods.","PeriodicalId":506672,"journal":{"name":"Journal of Mechanical Design","volume":"58 11","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-02-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Modified structure of deep neural network for training multi-fidelity data with non-common input variables\",\"authors\":\"Hwisang Jo, Byeong-uk Song, Joon-Yong Huh, Seungkyu Lee, Ikjin Lee\",\"doi\":\"10.1115/1.4064782\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n Multi-fidelity surrogate (MFS) modeling technology, which efficiently constructs surrogate models using low-fidelity (LF) and high-fidelity (HF) data, has been studied to enhance the predictive capability of engineering performances. In addition, several neural network (NN) structures for MFS modeling have been introduced, benefiting from recent developments in deep learning research. However, existing multi-fidelity (MF) NNs have been developed assuming identical sets of input variables for LF and HF data, a condition that is often not met in practical engineering systems. Therefore, this study proposes a new structure of composite NN designed for MF data with different input variables. The proposed network structure includes an input mapping network that connects the LF and HF data's input variables. Even when the physical relationship between these variables is unknown, the input mapping network can be concurrently trained during the process of training the whole network model. Customized loss functions and activation variables are suggested in this study to facilitate forward and backward propagation for the proposed NN structures when training MF data with different inputs. The effectiveness of the proposed method, in terms of prediction accuracy, is demonstrated through mathematical examples and practical engineering problems related to tire performances. The results confirm that the proposed method offers better accuracy than existing surrogate models in most problems. Moreover, the proposed method proves advantageous for surrogate modeling of nonlinear or discrete functions, a characteristic feature of NN-based methods.\",\"PeriodicalId\":506672,\"journal\":{\"name\":\"Journal of Mechanical Design\",\"volume\":\"58 11\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-02-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Mechanical Design\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1115/1.4064782\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Mechanical Design","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1115/1.4064782","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
多保真度代用(MFS)建模技术是一种利用低保真度(LF)和高保真度(HF)数据有效构建代用模型的技术,已被用于提高工程性能的预测能力。此外,得益于深度学习研究的最新发展,一些用于 MFS 建模的神经网络(NN)结构也被引入。然而,现有的多保真度(MF)神经网络是在假设低频和高频数据的输入变量集完全相同的情况下开发的,而这一条件在实际工程系统中往往无法满足。因此,本研究提出了一种新的复合网络结构,专为具有不同输入变量的 MF 数据而设计。建议的网络结构包括一个连接低频和高频数据输入变量的输入映射网络。即使这些变量之间的物理关系未知,也可以在训练整个网络模型的过程中同时训练输入映射网络。本研究提出了定制的损失函数和激活变量,以便在训练具有不同输入的中频数据时,为所提出的网络结构提供前向和后向传播。通过与轮胎性能相关的数学实例和实际工程问题,证明了所提方法在预测精度方面的有效性。结果证实,在大多数问题上,所提出的方法比现有的代用模型具有更高的准确性。此外,所提出的方法在非线性或离散函数的代用建模方面具有优势,这也是基于 NN 方法的一个特点。
Modified structure of deep neural network for training multi-fidelity data with non-common input variables
Multi-fidelity surrogate (MFS) modeling technology, which efficiently constructs surrogate models using low-fidelity (LF) and high-fidelity (HF) data, has been studied to enhance the predictive capability of engineering performances. In addition, several neural network (NN) structures for MFS modeling have been introduced, benefiting from recent developments in deep learning research. However, existing multi-fidelity (MF) NNs have been developed assuming identical sets of input variables for LF and HF data, a condition that is often not met in practical engineering systems. Therefore, this study proposes a new structure of composite NN designed for MF data with different input variables. The proposed network structure includes an input mapping network that connects the LF and HF data's input variables. Even when the physical relationship between these variables is unknown, the input mapping network can be concurrently trained during the process of training the whole network model. Customized loss functions and activation variables are suggested in this study to facilitate forward and backward propagation for the proposed NN structures when training MF data with different inputs. The effectiveness of the proposed method, in terms of prediction accuracy, is demonstrated through mathematical examples and practical engineering problems related to tire performances. The results confirm that the proposed method offers better accuracy than existing surrogate models in most problems. Moreover, the proposed method proves advantageous for surrogate modeling of nonlinear or discrete functions, a characteristic feature of NN-based methods.