Testing a Planned Missing Design to Reduce Respondent Burden in Web and SMS Administrations of the CAHPS Clinician and Group Survey (CG-CAHPS)

IF 0.5 4区数学 Q4 SOCIAL SCIENCES, MATHEMATICAL METHODS

Journal of Official Statistics Pub Date : 2022-12-01 DOI:10.2478/jos-2022-0042

P. Brenner, J. Hargraves, Carol Cosenza

{"title":"Testing a Planned Missing Design to Reduce Respondent Burden in Web and SMS Administrations of the CAHPS Clinician and Group Survey (CG-CAHPS)","authors":"P. Brenner, J. Hargraves, Carol Cosenza","doi":"10.2478/jos-2022-0042","DOIUrl":null,"url":null,"abstract":"Abstract We test a planned missing design to reduce respondent burden in Web and SMS administrations of the CAHPS Clinician and Group Survey (CG-CAHPS), a survey of patient experiences widely used by health care providers. Members of an online nonprobability panel were randomly assigned to one of three invitation and data collection mode protocols: email invitation to a Web survey, SMS invitation to a Web survey, or SMS invitation to an SMS survey. Within these three mode protocols, respondents were randomly assigned to a planned missing design, which shortened the survey by about 40%, or to a control group that received the survey in its entirety. We compare survey duration, breakoff and completion rates, and five key patient experience measures across conditions to assess the effect of the planned missing design across the three modes. We found that a planned missing design worked well with our Web survey, reducing survey duration and breakoff without changing estimates relative to the full-survey control condition. However, mixed findings in the SMS survey suggest that even shortened, 15-item surveys may be too long to substantially reduce respondent burden. We conclude with recommendations for future research.","PeriodicalId":51092,"journal":{"name":"Journal of Official Statistics","volume":null,"pages":null},"PeriodicalIF":0.5000,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Official Statistics","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.2478/jos-2022-0042","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"SOCIAL SCIENCES, MATHEMATICAL METHODS","Score":null,"Total":0}

引用次数: 0

Abstract

Abstract We test a planned missing design to reduce respondent burden in Web and SMS administrations of the CAHPS Clinician and Group Survey (CG-CAHPS), a survey of patient experiences widely used by health care providers. Members of an online nonprobability panel were randomly assigned to one of three invitation and data collection mode protocols: email invitation to a Web survey, SMS invitation to a Web survey, or SMS invitation to an SMS survey. Within these three mode protocols, respondents were randomly assigned to a planned missing design, which shortened the survey by about 40%, or to a control group that received the survey in its entirety. We compare survey duration, breakoff and completion rates, and five key patient experience measures across conditions to assess the effect of the planned missing design across the three modes. We found that a planned missing design worked well with our Web survey, reducing survey duration and breakoff without changing estimates relative to the full-survey control condition. However, mixed findings in the SMS survey suggest that even shortened, 15-item surveys may be too long to substantially reduce respondent burden. We conclude with recommendations for future research.

查看原文本刊更多论文

测试计划缺失设计以减轻CAHPS临床和群体调查(CG-CAHPS)网络和短信管理中的被调查者负担

摘要我们测试了一种计划缺失的设计，以减少CAHPS临床医生和团体调查（CG-CAHPS）的网络和短信管理中的受访者负担，这是一项广泛用于医疗保健提供者的患者体验调查。在线不可能性小组的成员被随机分配到三种邀请和数据收集模式协议中的一种：网络调查的电子邮件邀请、网络调查的短信邀请或短信调查的短信邀请函。在这三种模式的方案中，受访者被随机分配到一个计划缺失的设计中，该设计将调查缩短了约40%，或者被分配到接受完整调查的对照组。我们比较了调查持续时间、中断率和完成率，以及不同条件下的五个关键患者体验指标，以评估计划缺失设计对三种模式的影响。我们发现，计划中的缺失设计与我们的网络调查效果良好，减少了调查持续时间和中断，而不会改变相对于完整调查控制条件的估计。然而，短信调查的结果喜忧参半，表明即使是缩短的15项调查也可能太长，无法大幅减轻受访者的负担。最后，我们提出了未来研究的建议。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Official Statistics STATISTICS & PROBABILITY-

CiteScore

1.90

自引率

9.10%

发文量

审稿时长

>12 weeks

期刊介绍： JOS is an international quarterly published by Statistics Sweden. We publish research articles in the area of survey and statistical methodology and policy matters facing national statistical offices and other producers of statistics. The intended readers are researchers or practicians at statistical agencies or in universities and private organizations dealing with problems which concern aspects of production of official statistics.