{"title":"Is economics self‐correcting? Replications in the American Economic Review","authors":"Jörg Ankel‐Peters, Nathan Fiala, Florian Neubauer","doi":"10.1111/ecin.13222","DOIUrl":null,"url":null,"abstract":"This paper reviews the impact of replications published as comments in the <jats:italic>American Economic Review</jats:italic> between 2010 and 2020. We examine their citations and influence on the original papers' (OPs) subsequent citations. Our results show that comments are barely cited, and they do not affect the OP's citations—even if the comment diagnoses substantive problems. Furthermore, we conduct an opinion survey among replicators and authors and find that there often is no consensus on whether the OP's contribution sustains. We conclude that the economics literature does not self‐correct, and that robustness and replicability are hard to define in economics.","PeriodicalId":51380,"journal":{"name":"Economic Inquiry","volume":"13 1","pages":""},"PeriodicalIF":1.7000,"publicationDate":"2024-04-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Economic Inquiry","FirstCategoryId":"96","ListUrlMain":"https://doi.org/10.1111/ecin.13222","RegionNum":4,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ECONOMICS","Score":null,"Total":0}
引用次数: 0
Abstract
This paper reviews the impact of replications published as comments in the American Economic Review between 2010 and 2020. We examine their citations and influence on the original papers' (OPs) subsequent citations. Our results show that comments are barely cited, and they do not affect the OP's citations—even if the comment diagnoses substantive problems. Furthermore, we conduct an opinion survey among replicators and authors and find that there often is no consensus on whether the OP's contribution sustains. We conclude that the economics literature does not self‐correct, and that robustness and replicability are hard to define in economics.
期刊介绍:
Published since 1962, (formerly Western Economic Journal), EI is widely regarded as one of the top scholarly journals in its field. Besides containing research on all economics topic areas, a principal objective is to make each article understandable to economists who are not necessarily specialists in the article topic area. Nine Nobel laureates are among EI long list of prestigious authors.