A Practical Guide to Dealing with Attrition in Political Science Experiments

IF 3.2 Q1 POLITICAL SCIENCE
Adeline Lo, Jonathan Renshon, Lotem Bassan-Nygate
{"title":"A Practical Guide to Dealing with Attrition in Political Science Experiments","authors":"Adeline Lo, Jonathan Renshon, Lotem Bassan-Nygate","doi":"10.1017/xps.2023.22","DOIUrl":null,"url":null,"abstract":"Abstract Despite admonitions to address attrition in experiments – missingness on Y – alongside best practices designed to encourage transparency, most political science researchers all but ignore it. A quantitative literature search of this journal – where we would expect to find the most conscientious reporting of attrition – shows low rates of discussion of the issue. We suspect that there is confusion on the link between when attrition occurs and the type of validity it threatens when present, and limited connection to and guidance on which estimands are threatened by different attrition patterns. This is all exacerbated by limited tools to identify, investigate, and report patterns attrition. We offer the R package – attritevis – to visualize attrition over time, by intervention, and include a step-by-step guide to identifying and addressing attrition that balances post hoc analytical tools with guidance for revising designs to ameliorate problematic attrition.","PeriodicalId":37558,"journal":{"name":"Journal of Experimental Political Science","volume":null,"pages":null},"PeriodicalIF":3.2000,"publicationDate":"2023-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Experimental Political Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1017/xps.2023.22","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"POLITICAL SCIENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Abstract Despite admonitions to address attrition in experiments – missingness on Y – alongside best practices designed to encourage transparency, most political science researchers all but ignore it. A quantitative literature search of this journal – where we would expect to find the most conscientious reporting of attrition – shows low rates of discussion of the issue. We suspect that there is confusion on the link between when attrition occurs and the type of validity it threatens when present, and limited connection to and guidance on which estimands are threatened by different attrition patterns. This is all exacerbated by limited tools to identify, investigate, and report patterns attrition. We offer the R package – attritevis – to visualize attrition over time, by intervention, and include a step-by-step guide to identifying and addressing attrition that balances post hoc analytical tools with guidance for revising designs to ameliorate problematic attrition.
处理政治学实验中的损耗的实用指南
尽管有人警告说,除了旨在鼓励透明度的最佳实践外,还要解决实验中的损耗问题——Y缺失问题,但大多数政治学研究人员几乎都忽略了这个问题。对该杂志的定量文献检索显示,对这个问题的讨论率很低,我们期望在这里找到最认真的人员流失报告。我们怀疑,在损耗发生的时间和它所威胁的有效性类型之间的联系上存在混淆,并且与评估受到不同损耗模式威胁的联系和指导有限。识别、调查和报告模式损耗的有限工具加剧了这一点。我们提供了R包- attritevis -通过干预来可视化人员流失,并包括一个逐步识别和解决人员流失的指南,该指南平衡了事后分析工具和修改设计的指导,以改善有问题的人员流失。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Experimental Political Science
Journal of Experimental Political Science Social Sciences-Sociology and Political Science
CiteScore
5.10
自引率
8.30%
发文量
25
期刊介绍: The Journal of Experimental Political Science (JEPS) features cutting-edge research that utilizes experimental methods or experimental reasoning based on naturally occurring data. We define experimental methods broadly: research featuring random (or quasi-random) assignment of subjects to different treatments in an effort to isolate causal relationships in the sphere of politics. JEPS embraces all of the different types of experiments carried out as part of political science research, including survey experiments, laboratory experiments, field experiments, lab experiments in the field, natural and neurological experiments. We invite authors to submit concise articles (around 4000 words or fewer) that immediately address the subject of the research. We do not require lengthy explanations regarding and justifications of the experimental method. Nor do we expect extensive literature reviews of pros and cons of the methodological approaches involved in the experiment unless the goal of the article is to explore these methodological issues. We expect readers to be familiar with experimental methods and therefore to not need pages of literature reviews to be convinced that experimental methods are a legitimate methodological approach. We will consider longer articles in rare, but appropriate cases, as in the following examples: when a new experimental method or approach is being introduced and discussed or when novel theoretical results are being evaluated through experimentation. Finally, we strongly encourage authors to submit manuscripts that showcase informative null findings or inconsistent results from well-designed, executed, and analyzed experiments.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信