{"title":"气候模型开发者如何处理bug","authors":"Ulrike Proske, Lieke A. Melsen","doi":"10.1029/2025EF006318","DOIUrl":null,"url":null,"abstract":"<p>General circulation models (GCMs) are not only powerful tools to understand Earth's climate system and to forecast the weather. They are also large software programs written by humans. As such, they contain coding mistakes, so-called bugs. Researchers communicate results generated with GCMs and document new model versions, but seldom explicitly communicate the bugs they find in their models, let alone the practices surrounding them. This study portrays practices around bugs that were found during recent ICON development, and the workflow from getting a suspicion to fixing and communicating the bug. Eleven qualitative in-depth interviews were conducted with domain scientists and scientific programmers involved in ICON development. The interviews detail the workflow for dealing with bugs, highlighting that it is only partly standardized. For example, scientific testing is complicated by the fact that there is no absolute truth in terms of results that the model could be tested against. Thus testing resists standardization, so that dealing with bugs remains a laborious process. Being confronted and dealing with bugs, modelers aim for a model that is “good enough” rather than perfect. This stance is pragmatic and relaxes exuberant expectations for GCMs, especially considering their bugs. However, the goal of “good enough” is troubling with regard to GCMs' use as universal tools, with high societal stakes. Who decides that the model is “good enough,” and what for?</p>","PeriodicalId":48748,"journal":{"name":"Earths Future","volume":"13 8","pages":""},"PeriodicalIF":8.2000,"publicationDate":"2025-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://agupubs.onlinelibrary.wiley.com/doi/epdf/10.1029/2025EF006318","citationCount":"0","resultStr":"{\"title\":\"How Climate Model Developers Deal With Bugs\",\"authors\":\"Ulrike Proske, Lieke A. Melsen\",\"doi\":\"10.1029/2025EF006318\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>General circulation models (GCMs) are not only powerful tools to understand Earth's climate system and to forecast the weather. They are also large software programs written by humans. As such, they contain coding mistakes, so-called bugs. Researchers communicate results generated with GCMs and document new model versions, but seldom explicitly communicate the bugs they find in their models, let alone the practices surrounding them. This study portrays practices around bugs that were found during recent ICON development, and the workflow from getting a suspicion to fixing and communicating the bug. Eleven qualitative in-depth interviews were conducted with domain scientists and scientific programmers involved in ICON development. The interviews detail the workflow for dealing with bugs, highlighting that it is only partly standardized. For example, scientific testing is complicated by the fact that there is no absolute truth in terms of results that the model could be tested against. Thus testing resists standardization, so that dealing with bugs remains a laborious process. Being confronted and dealing with bugs, modelers aim for a model that is “good enough” rather than perfect. This stance is pragmatic and relaxes exuberant expectations for GCMs, especially considering their bugs. However, the goal of “good enough” is troubling with regard to GCMs' use as universal tools, with high societal stakes. Who decides that the model is “good enough,” and what for?</p>\",\"PeriodicalId\":48748,\"journal\":{\"name\":\"Earths Future\",\"volume\":\"13 8\",\"pages\":\"\"},\"PeriodicalIF\":8.2000,\"publicationDate\":\"2025-08-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://agupubs.onlinelibrary.wiley.com/doi/epdf/10.1029/2025EF006318\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Earths Future\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2025EF006318\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENVIRONMENTAL SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Earths Future","FirstCategoryId":"89","ListUrlMain":"https://agupubs.onlinelibrary.wiley.com/doi/10.1029/2025EF006318","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
General circulation models (GCMs) are not only powerful tools to understand Earth's climate system and to forecast the weather. They are also large software programs written by humans. As such, they contain coding mistakes, so-called bugs. Researchers communicate results generated with GCMs and document new model versions, but seldom explicitly communicate the bugs they find in their models, let alone the practices surrounding them. This study portrays practices around bugs that were found during recent ICON development, and the workflow from getting a suspicion to fixing and communicating the bug. Eleven qualitative in-depth interviews were conducted with domain scientists and scientific programmers involved in ICON development. The interviews detail the workflow for dealing with bugs, highlighting that it is only partly standardized. For example, scientific testing is complicated by the fact that there is no absolute truth in terms of results that the model could be tested against. Thus testing resists standardization, so that dealing with bugs remains a laborious process. Being confronted and dealing with bugs, modelers aim for a model that is “good enough” rather than perfect. This stance is pragmatic and relaxes exuberant expectations for GCMs, especially considering their bugs. However, the goal of “good enough” is troubling with regard to GCMs' use as universal tools, with high societal stakes. Who decides that the model is “good enough,” and what for?
期刊介绍:
Earth’s Future: A transdisciplinary open access journal, Earth’s Future focuses on the state of the Earth and the prediction of the planet’s future. By publishing peer-reviewed articles as well as editorials, essays, reviews, and commentaries, this journal will be the preeminent scholarly resource on the Anthropocene. It will also help assess the risks and opportunities associated with environmental changes and challenges.