Zichen Wang , Zhengqiang Pan , Yanlin Wang , Zhitao Long , Zhijun Cheng , Guang Jin
{"title":"隐变量逼近中嵌入参数估计的多类型混合响应高斯过程","authors":"Zichen Wang , Zhengqiang Pan , Yanlin Wang , Zhitao Long , Zhijun Cheng , Guang Jin","doi":"10.1016/j.aei.2025.103826","DOIUrl":null,"url":null,"abstract":"<div><div>Equipment performance experiments often collect multiple response metrics concurrently, comprising both qualitative and quantitative measures with potential complex interdependencies. However, conventional surrogate models typically fail to capture such intricate data structures. Therefore, joint modelling of multi-type mixed response data remains a critical challenge in the field of experimental design and evaluation. To address this issue, a multi-type mixed response Gaussian process model (MMRGP) is proposed in this paper, inspired by multi-output Gaussian process frameworks. The model unifies disparate data types by introducing latent variables for categorical responses and constructs a mixed-response covariance matrix to characterize inter-response correlations. However, incorporating latent variables makes parameter estimation dependent on them, while their approximate optimization is concurrently affected by model parameters. To resolve this coupled problem of parameter estimation and latent variable approximation, a bi-level optimization method is proposed that embeds latent variable approximation within parameter estimation, enabling simultaneous solving and refinement. The proposed method is validated through numerical examples and real-world datasets involving mixed responses. Comparative analyses show superior prediction accuracy and stability, with prediction errors reduced by approximately 10%–50% compared to independent modelling approaches. Finally, the MMRGP model is applied to radar anti-jamming performance experiment. The results confirm the practical efficacy and reference value for engineering applications.</div></div>","PeriodicalId":50941,"journal":{"name":"Advanced Engineering Informatics","volume":"69 ","pages":"Article 103826"},"PeriodicalIF":9.9000,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multi-type mixed response Gaussian process with parameter estimation embedded in latent variable approximation\",\"authors\":\"Zichen Wang , Zhengqiang Pan , Yanlin Wang , Zhitao Long , Zhijun Cheng , Guang Jin\",\"doi\":\"10.1016/j.aei.2025.103826\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Equipment performance experiments often collect multiple response metrics concurrently, comprising both qualitative and quantitative measures with potential complex interdependencies. However, conventional surrogate models typically fail to capture such intricate data structures. Therefore, joint modelling of multi-type mixed response data remains a critical challenge in the field of experimental design and evaluation. To address this issue, a multi-type mixed response Gaussian process model (MMRGP) is proposed in this paper, inspired by multi-output Gaussian process frameworks. The model unifies disparate data types by introducing latent variables for categorical responses and constructs a mixed-response covariance matrix to characterize inter-response correlations. However, incorporating latent variables makes parameter estimation dependent on them, while their approximate optimization is concurrently affected by model parameters. To resolve this coupled problem of parameter estimation and latent variable approximation, a bi-level optimization method is proposed that embeds latent variable approximation within parameter estimation, enabling simultaneous solving and refinement. The proposed method is validated through numerical examples and real-world datasets involving mixed responses. Comparative analyses show superior prediction accuracy and stability, with prediction errors reduced by approximately 10%–50% compared to independent modelling approaches. Finally, the MMRGP model is applied to radar anti-jamming performance experiment. The results confirm the practical efficacy and reference value for engineering applications.</div></div>\",\"PeriodicalId\":50941,\"journal\":{\"name\":\"Advanced Engineering Informatics\",\"volume\":\"69 \",\"pages\":\"Article 103826\"},\"PeriodicalIF\":9.9000,\"publicationDate\":\"2025-09-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advanced Engineering Informatics\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1474034625007190\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advanced Engineering Informatics","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1474034625007190","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Multi-type mixed response Gaussian process with parameter estimation embedded in latent variable approximation
Equipment performance experiments often collect multiple response metrics concurrently, comprising both qualitative and quantitative measures with potential complex interdependencies. However, conventional surrogate models typically fail to capture such intricate data structures. Therefore, joint modelling of multi-type mixed response data remains a critical challenge in the field of experimental design and evaluation. To address this issue, a multi-type mixed response Gaussian process model (MMRGP) is proposed in this paper, inspired by multi-output Gaussian process frameworks. The model unifies disparate data types by introducing latent variables for categorical responses and constructs a mixed-response covariance matrix to characterize inter-response correlations. However, incorporating latent variables makes parameter estimation dependent on them, while their approximate optimization is concurrently affected by model parameters. To resolve this coupled problem of parameter estimation and latent variable approximation, a bi-level optimization method is proposed that embeds latent variable approximation within parameter estimation, enabling simultaneous solving and refinement. The proposed method is validated through numerical examples and real-world datasets involving mixed responses. Comparative analyses show superior prediction accuracy and stability, with prediction errors reduced by approximately 10%–50% compared to independent modelling approaches. Finally, the MMRGP model is applied to radar anti-jamming performance experiment. The results confirm the practical efficacy and reference value for engineering applications.
期刊介绍:
Advanced Engineering Informatics is an international Journal that solicits research papers with an emphasis on 'knowledge' and 'engineering applications'. The Journal seeks original papers that report progress in applying methods of engineering informatics. These papers should have engineering relevance and help provide a scientific base for more reliable, spontaneous, and creative engineering decision-making. Additionally, papers should demonstrate the science of supporting knowledge-intensive engineering tasks and validate the generality, power, and scalability of new methods through rigorous evaluation, preferably both qualitatively and quantitatively. Abstracting and indexing for Advanced Engineering Informatics include Science Citation Index Expanded, Scopus and INSPEC.