Comparative performance analysis of optimization algorithms for hyperparameter tuning in LSBoost modeling of mechanical properties in FDM-printed nanocomposites
IF 7.5 1区 计算机科学Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Mirsadegh Seyedzavvar , Cem Boğa , Behzad Hashemi Soudmand
{"title":"Comparative performance analysis of optimization algorithms for hyperparameter tuning in LSBoost modeling of mechanical properties in FDM-printed nanocomposites","authors":"Mirsadegh Seyedzavvar , Cem Boğa , Behzad Hashemi Soudmand","doi":"10.1016/j.eswa.2025.128111","DOIUrl":null,"url":null,"abstract":"<div><div>Hyperparameter tuning is essential for developing accurate machine learning models, yet its role in predicting the mechanical properties of 3D-printed nanocomposites remains underexplored. This study evaluates the performance of three optimization techniques—Bayesian Optimization (BO), Simulated Annealing (SA), and Genetic Algorithm (GA)—in tuning a Least Squares Boosting (LSBoost) model for predicting the mechanical properties of fused deposition modeling (FDM) 3D-printed polylactic acid (PLA)/silica (SiO<sub>2</sub>) nanocomposites. The properties assessed include modulus of elasticity (<span><math><mrow><mi>E</mi></mrow></math></span>), yield strength (<span><math><mrow><msub><mi>S</mi><mi>y</mi></msub></mrow></math></span>), and toughness at ultimate strength (<span><math><mrow><msub><mi>K</mi><mi>u</mi></msub></mrow></math></span>), influenced by key process parameters: extrusion rate (ER), SiO<sub>2</sub> nanoparticle concentration (SC), deposition layer thickness (LT), infill density (ID), and infill geometry (IG). Tensile specimens were produced using a Taguchi L<sub>27</sub> orthogonal array and tested under uniaxial tension. Tuning of the LSBoost model minimized a composite objective function involving root mean square error (RMSE) and (1 − <span><math><mrow><msup><mrow><mi>R</mi></mrow><mn>2</mn></msup></mrow></math></span>) loss metrics. Results demonstrated that GA achieved the best performance for yield strength prediction, with an RMSE of 1.9526 MPa and R<sup>2</sup> of 0.9713, while BO yielded the highest <span><math><mrow><msup><mrow><mi>R</mi></mrow><mn>2</mn></msup></mrow></math></span> (0.9776) for modulus of elasticity prediction with a test RMSE of 130.13 MPa. For toughness, GA produced the lowest test RMSE of 102.86 MPa and the highest R<sup>2</sup> of 0.7953 among the optimization methods. Generally, GA consistently outperformed BO and SA in optimizing the LSBoost model across most mechanical properties, highlighting its effectiveness for hyperparameter tuning in the context of FDM-fabricated nanocomposites.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"287 ","pages":"Article 128111"},"PeriodicalIF":7.5000,"publicationDate":"2025-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425017324","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Hyperparameter tuning is essential for developing accurate machine learning models, yet its role in predicting the mechanical properties of 3D-printed nanocomposites remains underexplored. This study evaluates the performance of three optimization techniques—Bayesian Optimization (BO), Simulated Annealing (SA), and Genetic Algorithm (GA)—in tuning a Least Squares Boosting (LSBoost) model for predicting the mechanical properties of fused deposition modeling (FDM) 3D-printed polylactic acid (PLA)/silica (SiO2) nanocomposites. The properties assessed include modulus of elasticity (), yield strength (), and toughness at ultimate strength (), influenced by key process parameters: extrusion rate (ER), SiO2 nanoparticle concentration (SC), deposition layer thickness (LT), infill density (ID), and infill geometry (IG). Tensile specimens were produced using a Taguchi L27 orthogonal array and tested under uniaxial tension. Tuning of the LSBoost model minimized a composite objective function involving root mean square error (RMSE) and (1 − ) loss metrics. Results demonstrated that GA achieved the best performance for yield strength prediction, with an RMSE of 1.9526 MPa and R2 of 0.9713, while BO yielded the highest (0.9776) for modulus of elasticity prediction with a test RMSE of 130.13 MPa. For toughness, GA produced the lowest test RMSE of 102.86 MPa and the highest R2 of 0.7953 among the optimization methods. Generally, GA consistently outperformed BO and SA in optimizing the LSBoost model across most mechanical properties, highlighting its effectiveness for hyperparameter tuning in the context of FDM-fabricated nanocomposites.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.