导致复制危机的其他因素：预测与评估。

IF 3 4区社会学 Q1 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation Review Pub Date : 2025-02-01 Epub Date: 2024-02-20 DOI:10.1177/0193841X241229106

Gregory Chernov

{"title":"导致复制危机的其他因素：预测与评估。","authors":"Gregory Chernov","doi":"10.1177/0193841X241229106","DOIUrl":null,"url":null,"abstract":"Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most qualified expert. This mechanism can be seamlessly integrated into the existing replication prediction market framework with minimal implementation costs. It relies on an objective rather than subjective process and unstructured expert opinions to effectively identify various influences contributing to the replication crisis.","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":" ","pages":"147-164"},"PeriodicalIF":3.0000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Alternative Factors Leading to Replication Crisis: Prediction and Evaluation.\",\"authors\":\"Gregory Chernov\",\"doi\":\"10.1177/0193841X241229106\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most qualified expert. This mechanism can be seamlessly integrated into the existing replication prediction market framework with minimal implementation costs. It relies on an objective rather than subjective process and unstructured expert opinions to effectively identify various influences contributing to the replication crisis.\",\"PeriodicalId\":47533,\"journal\":{\"name\":\"Evaluation Review\",\"volume\":\" \",\"pages\":\"147-164\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2025-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Evaluation Review\",\"FirstCategoryId\":\"90\",\"ListUrlMain\":\"https://doi.org/10.1177/0193841X241229106\",\"RegionNum\":4,\"RegionCategory\":\"社会学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/2/20 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"SOCIAL SCIENCES, INTERDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Evaluation Review","FirstCategoryId":"90","ListUrlMain":"https://doi.org/10.1177/0193841X241229106","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/2/20 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"SOCIAL SCIENCES, INTERDISCIPLINARY","Score":null,"Total":0}

引用次数: 0

摘要

针对当前科学界的复制危机，现有的大多数解决方案都只能解决源于特定不良研究实践的因素。我们引入了一种新的机制，利用专家的预测能力来分析复制失败的根本原因。它所遵循的原则是：最准确的预测者就是最合格的专家。这种机制可以无缝集成到现有的复制预测市场框架中，实施成本极低。它依靠客观而非主观的过程和非结构化的专家意见，有效识别导致复制危机的各种影响因素。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

The Alternative Factors Leading to Replication Crisis: Prediction and Evaluation.

Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most qualified expert. This mechanism can be seamlessly integrated into the existing replication prediction market framework with minimal implementation costs. It relies on an objective rather than subjective process and unstructured expert opinions to effectively identify various influences contributing to the replication crisis.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Evaluation Review SOCIAL SCIENCES, INTERDISCIPLINARY-

CiteScore

2.90

自引率

11.10%

发文量

期刊介绍： Evaluation Review is the forum for researchers, planners, and policy makers engaged in the development, implementation, and utilization of studies aimed at the betterment of the human condition. The Editors invite submission of papers reporting the findings of evaluation studies in such fields as child development, health, education, income security, manpower, mental health, criminal justice, and the physical and social environments. In addition, Evaluation Review will contain articles on methodological developments, discussions of the state of the art, and commentaries on issues related to the application of research results. Special features will include periodic review essays, "research briefs", and "craft reports".