Proceedings of the 2023 ACM Conference on Reproducibility and Replicability最新文献

筛选

英文中文

Does the Market of Citations Reward Reproducible Work? 引文市场奖励可复制的作品吗?

Proceedings of the 2023 ACM Conference on Reproducibility and Replicability Pub Date : 2022-04-08 DOI: 10.1145/3589806.3600041

Edward Raff

{"title":"Does the Market of Citations Reward Reproducible Work?","authors":"Edward Raff","doi":"10.1145/3589806.3600041","DOIUrl":"https://doi.org/10.1145/3589806.3600041","url":null,"abstract":"The field of bibliometrics, studying citations and behavior, is critical to the discussion of reproducibility. Citations are one of the primary incentive and reward systems for academic work, and so we desire to know if this incentive rewards reproducible work. Yet to the best of our knowledge, only one work has attempted to look at this combined space, concluding that non-reproducible work is more highly cited. We show that answering this question is more challenging than first proposed, and subtle issues can inhibit a robust conclusion. To make inferences with more robust behavior, we propose a hierarchical Bayesian model that incorporates the citation rate over time, rather than the total number of citations after a fixed amount of time. In doing so we show that, under current evidence the answer is more likely that certain fields of study such as Medicine and Machine Learning (ML) do reward reproducible works with more citations, but other fields appear to have no relationship. Further, we find that making code available and thoroughly referencing prior works appear to also positively correlate with increased citations. Our code can be found at the following link: https://github.com/EdwardRaff/ReproducibleCitations/","PeriodicalId":393751,"journal":{"name":"Proceedings of the 2023 ACM Conference on Reproducibility and Replicability","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130797923","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 7

Proceedings of the 2023 ACM Conference on Reproducibility and Replicability 2023年美国计算机学会可重复性和可复制性会议论文集

Proceedings of the 2023 ACM Conference on Reproducibility and Replicability Pub Date : 1900-01-01 DOI: 10.1145/3589806

引用次数: 0

首页上一页