{"title":"Challenges and Techniques for Reproducible Simulations","authors":"Curran D. Muhlberger","doi":"10.1109/mcse.2023.3322127","DOIUrl":null,"url":null,"abstract":"Too often, reproducibility is unnecessarily sacrificed in new simulation codes. We explore some ways in which this happens and provide recommendations for reclaiming it. Experience shows that robust bitwise reproducibility on a fixed runtime platform is a desirable and achievable target. The variety of threats considered suggests that maintaining a reproducible simulator to this degree requires vigilance, but, in addition to the usual benefits, the increased effort is rewarded on the software engineering front by enabling low-overhead techniques to detect bugs sooner and diagnose them faster.","PeriodicalId":10553,"journal":{"name":"Computing in Science & Engineering","volume":"27 1","pages":""},"PeriodicalIF":1.8000,"publicationDate":"2024-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computing in Science & Engineering","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1109/mcse.2023.3322127","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
Too often, reproducibility is unnecessarily sacrificed in new simulation codes. We explore some ways in which this happens and provide recommendations for reclaiming it. Experience shows that robust bitwise reproducibility on a fixed runtime platform is a desirable and achievable target. The variety of threats considered suggests that maintaining a reproducible simulator to this degree requires vigilance, but, in addition to the usual benefits, the increased effort is rewarded on the software engineering front by enabling low-overhead techniques to detect bugs sooner and diagnose them faster.
期刊介绍:
Physics, medicine, astronomy -- these and other hard sciences share a common need for efficient algorithms, system software, and computer architecture to address large computational problems. And yet, useful advances in computational techniques that could benefit many researchers are rarely shared. To meet that need, Computing in Science & Engineering presents scientific and computational contributions in a clear and accessible format.
The computational and data-centric problems faced by scientists and engineers transcend disciplines. There is a need to share knowledge of algorithms, software, and architectures, and to transmit lessons-learned to a broad scientific audience. CiSE is a cross-disciplinary, international publication that meets this need by presenting contributions of high interest and educational value from a variety of fields, including—but not limited to—physics, biology, chemistry, and astronomy. CiSE emphasizes innovative applications in advanced computing, simulation, and analytics, among other cutting-edge techniques. CiSE publishes peer-reviewed research articles, and also runs departments spanning news and analyses, topical reviews, tutorials, case studies, and more.