Yefeng Yang, Erik van Zwet, Nikolaos Ignatiadis, Shinichi Nakagawa
{"title":"A large-scale in silico replication of ecological and evolutionary studies","authors":"Yefeng Yang, Erik van Zwet, Nikolaos Ignatiadis, Shinichi Nakagawa","doi":"10.1038/s41559-024-02530-5","DOIUrl":null,"url":null,"abstract":"Despite the growing concerns about the replicability of ecological and evolutionary studies, no results exist from a field-wide replication project. We conduct a large-scale in silico replication project, leveraging cutting-edge statistical methodologies. Replicability is 30%–40% for studies with marginal statistical significance in the absence of selective reporting, whereas the replicability of studies presenting ‘strong’ evidence against the null hypothesis H0 is >70%. The former requires a sevenfold larger sample size to reach the latter’s replicability. We call for a change in planning, conducting and publishing research towards a transparent, credible and replicable ecology and evolution. Large-scale, direct replications of ecological and evolutionary studies are difficult to conduct. This paper applies statistical methods to meta-analyses of ecological and evolutionary studies to estimate replicability.","PeriodicalId":18835,"journal":{"name":"Nature ecology & evolution","volume":"8 12","pages":"2179-2183"},"PeriodicalIF":13.9000,"publicationDate":"2024-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s41559-024-02530-5.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature ecology & evolution","FirstCategoryId":"99","ListUrlMain":"https://www.nature.com/articles/s41559-024-02530-5","RegionNum":1,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ECOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Despite the growing concerns about the replicability of ecological and evolutionary studies, no results exist from a field-wide replication project. We conduct a large-scale in silico replication project, leveraging cutting-edge statistical methodologies. Replicability is 30%–40% for studies with marginal statistical significance in the absence of selective reporting, whereas the replicability of studies presenting ‘strong’ evidence against the null hypothesis H0 is >70%. The former requires a sevenfold larger sample size to reach the latter’s replicability. We call for a change in planning, conducting and publishing research towards a transparent, credible and replicable ecology and evolution. Large-scale, direct replications of ecological and evolutionary studies are difficult to conduct. This paper applies statistical methods to meta-analyses of ecological and evolutionary studies to estimate replicability.
Nature ecology & evolutionAgricultural and Biological Sciences-Ecology, Evolution, Behavior and Systematics
CiteScore
22.20
自引率
2.40%
发文量
282
期刊介绍:
Nature Ecology & Evolution is interested in the full spectrum of ecological and evolutionary biology, encompassing approaches at the molecular, organismal, population, community and ecosystem levels, as well as relevant parts of the social sciences. Nature Ecology & Evolution provides a place where all researchers and policymakers interested in all aspects of life's diversity can come together to learn about the most accomplished and significant advances in the field and to discuss topical issues. An online-only monthly journal, our broad scope ensures that the research published reaches the widest possible audience of scientists.