{"title":"A Systematic Review of Experimental Research on Public Service Motivation","authors":"Kee Hoon Chung, Inbok Rhee, Cheol Liu","doi":"10.1080/15309576.2023.2269386","DOIUrl":null,"url":null,"abstract":"AbstractExperimental research has been increasingly recognized as the gold standard for causal inference. However, despite the call for the adoption of experimental approaches to the study of public service motivation (PSM) – one of the most researched topics in the field of public administration – we find that the number of such studies is small in this first-ever review of systematic assessment of experimental research on PSM. Reviewing the universe of such experimental studies − 41 in total – by their topic and type, first, we find that they are concentrated on the analysis of the efforts of PSM and in survey experiments by type. Second, while many studies confirm that PSM positively influences various outcomes, they also show that other intrinsic and extrinsic motivations often outperformed PSM. Third, while acknowledging that methodologically, the randomization of treatment has been well adopted in recent years, we highlight some key recommendations for further improvements regarding the type of experiment, sample characteristics, measurement, and treatment sequences based on our review.Keywords: Experimentsfield experimentpublic service motivation (PSM)social desirability biassurveysystematic review Disclosure statementNo potential conflict of interest was reported by the author(s).Notes1 For the parsimony and replicability of our case selection, we followed the outlined process while limiting subjective researcher decisions as much as possible. That said, we acknowledge that we may have missed some closely related studies on PSM that did not directly use the term or did not involve experimental manipulation and random assignment of PSM or other key variables of interest that might causally affect PSM.2 The coding process included all three coauthors to thoroughly review the coding results. At the initial stage, all three coauthors jointly searched, screened, and reviewed the relevant articles. After obtaining 41 articles, two of the coauthors regularly held meetings – both face-to-face and via online – to discuss the coding results and decide which categories to code. In this process, the two coauthors independently read the articles and cross-checked the results. After the cross-validation by the two coauthors, the third coauthor conducted the final review.3 We categorized each study based on the information it provided as much as possible. For the most part, this was relatively easy since most studies explicitly described the type of experiment they conducted. One study (Sun et al., Citation2019) did not explicitly identify the type of experiment employed, and we used our discretion to categorize the study as a lab experiment.4 One article was categorized as both a lab and survey experiment. See Tepe et al. (Citation2022).5 Ranking fifth highest with 20 out of 400 studies (5% of the total), according to Ritz et al. (Citation2016).6 Table A1 in the Appendix provides more detailed analyses of each study.7 Detailed information available in the Table A2 in the Appendix8 Detailed information available in the Table A2 in the Appendix9 We did not find this to be an issue among the four studies that examined the determinants of PSM. Detailed information available in the Table A2 in the AppendixAdditional informationFundingThe research was funded by the Office of Development Research & International Cooperation at the KDI School of Public Policy and Management.Notes on contributorsKee Hoon ChungKee Hoon Chung is an Assistant Professor at Department of Public Administration, University of Ulsan.Inbok RheeInbok Rhee is an Associate Professor at KDI School of Public Policy & Management.Cheol LiuCheol Liu is a Professor at KDI School of Public Policy & Management.","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/15309576.2023.2269386","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
引用次数: 0
Abstract
AbstractExperimental research has been increasingly recognized as the gold standard for causal inference. However, despite the call for the adoption of experimental approaches to the study of public service motivation (PSM) – one of the most researched topics in the field of public administration – we find that the number of such studies is small in this first-ever review of systematic assessment of experimental research on PSM. Reviewing the universe of such experimental studies − 41 in total – by their topic and type, first, we find that they are concentrated on the analysis of the efforts of PSM and in survey experiments by type. Second, while many studies confirm that PSM positively influences various outcomes, they also show that other intrinsic and extrinsic motivations often outperformed PSM. Third, while acknowledging that methodologically, the randomization of treatment has been well adopted in recent years, we highlight some key recommendations for further improvements regarding the type of experiment, sample characteristics, measurement, and treatment sequences based on our review.Keywords: Experimentsfield experimentpublic service motivation (PSM)social desirability biassurveysystematic review Disclosure statementNo potential conflict of interest was reported by the author(s).Notes1 For the parsimony and replicability of our case selection, we followed the outlined process while limiting subjective researcher decisions as much as possible. That said, we acknowledge that we may have missed some closely related studies on PSM that did not directly use the term or did not involve experimental manipulation and random assignment of PSM or other key variables of interest that might causally affect PSM.2 The coding process included all three coauthors to thoroughly review the coding results. At the initial stage, all three coauthors jointly searched, screened, and reviewed the relevant articles. After obtaining 41 articles, two of the coauthors regularly held meetings – both face-to-face and via online – to discuss the coding results and decide which categories to code. In this process, the two coauthors independently read the articles and cross-checked the results. After the cross-validation by the two coauthors, the third coauthor conducted the final review.3 We categorized each study based on the information it provided as much as possible. For the most part, this was relatively easy since most studies explicitly described the type of experiment they conducted. One study (Sun et al., Citation2019) did not explicitly identify the type of experiment employed, and we used our discretion to categorize the study as a lab experiment.4 One article was categorized as both a lab and survey experiment. See Tepe et al. (Citation2022).5 Ranking fifth highest with 20 out of 400 studies (5% of the total), according to Ritz et al. (Citation2016).6 Table A1 in the Appendix provides more detailed analyses of each study.7 Detailed information available in the Table A2 in the Appendix8 Detailed information available in the Table A2 in the Appendix9 We did not find this to be an issue among the four studies that examined the determinants of PSM. Detailed information available in the Table A2 in the AppendixAdditional informationFundingThe research was funded by the Office of Development Research & International Cooperation at the KDI School of Public Policy and Management.Notes on contributorsKee Hoon ChungKee Hoon Chung is an Assistant Professor at Department of Public Administration, University of Ulsan.Inbok RheeInbok Rhee is an Associate Professor at KDI School of Public Policy & Management.Cheol LiuCheol Liu is a Professor at KDI School of Public Policy & Management.
摘要实验研究越来越被认为是因果推理的金标准。然而,尽管人们呼吁采用实验方法来研究公共服务动机(PSM),这是公共行政领域研究最多的主题之一,但我们发现,在对PSM实验研究的系统评估的首次回顾中,此类研究的数量很少。回顾这类实验研究的范围-总共41个-按主题和类型,首先,我们发现它们集中在PSM的努力分析和按类型的调查实验。其次,虽然许多研究证实PSM对各种结果有积极影响,但它们也表明其他内在和外在动机往往优于PSM。第三,虽然在方法学上,近年来治疗的随机化得到了很好的采用,但我们强调了一些关键的建议,以进一步改进实验类型,样本特征,测量和治疗顺序。关键词:实验;现场实验;公共服务动机;社会可取性;注1为了简化和可复制我们的案例选择,我们遵循了概述的过程,同时尽可能地限制了研究人员的主观决定。也就是说,我们承认我们可能错过了一些与PSM密切相关的研究,这些研究没有直接使用这个术语,或者没有涉及实验操作和随机分配PSM或其他可能对PSM产生因果影响的关键变量。2编码过程包括所有三位共同作者,以彻底审查编码结果。在初始阶段,三位共同作者共同检索、筛选和评审相关文章。在获得41篇文章后,两位合著者定期召开会议——面对面或通过网络——讨论编码结果并决定对哪些类别进行编码。在这个过程中,两位共同作者独立阅读文章并交叉核对结果。2 .经两位共同作者交叉验证后,由第三位共同作者进行最终审稿我们根据每项研究提供的尽可能多的信息对其进行分类。在大多数情况下,这相对容易,因为大多数研究都明确描述了他们进行的实验类型。一项研究(Sun et al., Citation2019)没有明确确定所采用的实验类型,我们根据自己的判断将该研究归类为实验室实验一篇文章被归类为实验室实验和调查实验。参见Tepe等人(Citation2022)根据Ritz et al. (Citation2016)的数据,400项研究中有20项排名第五(占总数的5%)附录中的表A1提供了对每项研究的更详细的分析附录中表A2提供的详细信息8附录中表A2提供的详细信息9我们在检查PSM决定因素的四项研究中没有发现这是一个问题。本研究由KDI公共政策与管理学院发展研究与国际合作办公室资助。郑勋(音译),蔚山大学公共行政学系助理教授。Inbok Rhee是KDI公共政策与管理学院的副教授。本文作者是KDI公共政策与管理学院教授。