Alejandra Duque-Torres , Claus Klammer , Stefan Fischer , Rudolf Ramler , Dietmar Pfahl
{"title":"Metamorphic testing for optimisation: A case study on PID controller tuning","authors":"Alejandra Duque-Torres , Claus Klammer , Stefan Fischer , Rudolf Ramler , Dietmar Pfahl","doi":"10.1016/j.infsof.2025.107872","DOIUrl":null,"url":null,"abstract":"<div><h3>Context:</h3><div>Tuning PID controller parameters is essential for achieving stable and efficient system behaviour. However, traditional methods often depend on expert heuristics or exhaustive simulations, which can be time-consuming and difficult to generalise across configurations.</div></div><div><h3>Objective:</h3><div>This paper explores Metamorphic Testing (MT) as a validation-driven approach for identifying optimal PID parameter set based on expected behavioural trends.</div></div><div><h3>Method:</h3><div>We define a set of domain-informed Metamorphic Relations (MRs) that capture control-theoretic expectations. These MRs are used to evaluate and compare simulated parameter sets, based on how many behavioural constraints they satisfy.</div></div><div><h3>Results:</h3><div>Our findings show that high MR satisfaction is a strong indicator of potentially optimal parameter sets, often yielding smooth, stable control responses. Although trade-offs between metrics—such as energy usage and error correction occasionally led to partial MR violations, expert-preferred parameter sets still closely matched those with the highest MR scores. These results support the use of MR-based evaluation as a practical approach to identifying high-quality tuning parameters.</div></div><div><h3>Conclusion:</h3><div>Metamorphic Testing offers an interpretable and structured way to guide controller tuning by formalising expected system behaviour. This approach helps identify near-optimal configurations and complements traditional tuning practices through systematic validation.</div></div>","PeriodicalId":54983,"journal":{"name":"Information and Software Technology","volume":"188 ","pages":"Article 107872"},"PeriodicalIF":4.3000,"publicationDate":"2025-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information and Software Technology","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950584925002113","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Context:
Tuning PID controller parameters is essential for achieving stable and efficient system behaviour. However, traditional methods often depend on expert heuristics or exhaustive simulations, which can be time-consuming and difficult to generalise across configurations.
Objective:
This paper explores Metamorphic Testing (MT) as a validation-driven approach for identifying optimal PID parameter set based on expected behavioural trends.
Method:
We define a set of domain-informed Metamorphic Relations (MRs) that capture control-theoretic expectations. These MRs are used to evaluate and compare simulated parameter sets, based on how many behavioural constraints they satisfy.
Results:
Our findings show that high MR satisfaction is a strong indicator of potentially optimal parameter sets, often yielding smooth, stable control responses. Although trade-offs between metrics—such as energy usage and error correction occasionally led to partial MR violations, expert-preferred parameter sets still closely matched those with the highest MR scores. These results support the use of MR-based evaluation as a practical approach to identifying high-quality tuning parameters.
Conclusion:
Metamorphic Testing offers an interpretable and structured way to guide controller tuning by formalising expected system behaviour. This approach helps identify near-optimal configurations and complements traditional tuning practices through systematic validation.
期刊介绍:
Information and Software Technology is the international archival journal focusing on research and experience that contributes to the improvement of software development practices. The journal''s scope includes methods and techniques to better engineer software and manage its development. Articles submitted for review should have a clear component of software engineering or address ways to improve the engineering and management of software development. Areas covered by the journal include:
• Software management, quality and metrics,
• Software processes,
• Software architecture, modelling, specification, design and programming
• Functional and non-functional software requirements
• Software testing and verification & validation
• Empirical studies of all aspects of engineering and managing software development
Short Communications is a new section dedicated to short papers addressing new ideas, controversial opinions, "Negative" results and much more. Read the Guide for authors for more information.
The journal encourages and welcomes submissions of systematic literature studies (reviews and maps) within the scope of the journal. Information and Software Technology is the premiere outlet for systematic literature studies in software engineering.