{"title":"Automated formal-specification-to-code trace links recovery using multi-dimensional similarity measures","authors":"Jiandong Li , Shaoying Liu , Zhi Jin","doi":"10.1016/j.jss.2025.112439","DOIUrl":null,"url":null,"abstract":"<div><div>Formal specification techniques are widely used in safety-critical system development, where precise alignment between the specification components and their implementation counterparts is essential for conformance verification and program maintenance. Existing methods for establishing these trace links are often inefficient, requiring manual effort, and automated approaches based on textual similarity suffer from low precision. In this paper, we propose a novel automated method that incorporates multi-dimensional attributes of formal specification components to improve trace link recovery. The underlying principle supporting our method is that the names, structures, and relationships of specification components are typically preserved in their implementation. Our method contains four steps: (1) identifying the components in both the specification and the code, (2) extracting the multi-dimensional attributes for both specification components and code components, (3) calculating their similarities, and (4) predicting trace links through ranking and comparing to a threshold. We evaluate our method across three projects and demonstrate that it performs better in average precision, recall and F1-score than existing text-based similarity techniques, including Latent Semantic Indexing, Vector Space Model, Word2Vec embeddings, and LLM-based embeddings. These results confirm that our approach provides a more effective and reliable solution for automatically establishing trace links between formal specifications and code.</div></div>","PeriodicalId":51099,"journal":{"name":"Journal of Systems and Software","volume":"226 ","pages":"Article 112439"},"PeriodicalIF":3.7000,"publicationDate":"2025-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Systems and Software","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0164121225001074","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, SOFTWARE ENGINEERING","Score":null,"Total":0}
引用次数: 0
Abstract
Formal specification techniques are widely used in safety-critical system development, where precise alignment between the specification components and their implementation counterparts is essential for conformance verification and program maintenance. Existing methods for establishing these trace links are often inefficient, requiring manual effort, and automated approaches based on textual similarity suffer from low precision. In this paper, we propose a novel automated method that incorporates multi-dimensional attributes of formal specification components to improve trace link recovery. The underlying principle supporting our method is that the names, structures, and relationships of specification components are typically preserved in their implementation. Our method contains four steps: (1) identifying the components in both the specification and the code, (2) extracting the multi-dimensional attributes for both specification components and code components, (3) calculating their similarities, and (4) predicting trace links through ranking and comparing to a threshold. We evaluate our method across three projects and demonstrate that it performs better in average precision, recall and F1-score than existing text-based similarity techniques, including Latent Semantic Indexing, Vector Space Model, Word2Vec embeddings, and LLM-based embeddings. These results confirm that our approach provides a more effective and reliable solution for automatically establishing trace links between formal specifications and code.
期刊介绍:
The Journal of Systems and Software publishes papers covering all aspects of software engineering and related hardware-software-systems issues. All articles should include a validation of the idea presented, e.g. through case studies, experiments, or systematic comparisons with other approaches already in practice. Topics of interest include, but are not limited to:
•Methods and tools for, and empirical studies on, software requirements, design, architecture, verification and validation, maintenance and evolution
•Agile, model-driven, service-oriented, open source and global software development
•Approaches for mobile, multiprocessing, real-time, distributed, cloud-based, dependable and virtualized systems
•Human factors and management concerns of software development
•Data management and big data issues of software systems
•Metrics and evaluation, data mining of software development resources
•Business and economic aspects of software development processes
The journal welcomes state-of-the-art surveys and reports of practical experience for all of these topics.