Response is increased using postal rather than electronic questionnaires – new results from an updated Cochrane Systematic Review

IF 3.9 3区医学 Q1 HEALTH CARE SCIENCES & SERVICES

BMC Medical Research Methodology Pub Date : 2024-09-16 DOI:10.1186/s12874-024-02332-0

Phil Edwards, Chloe Perkins

{"title":"Response is increased using postal rather than electronic questionnaires – new results from an updated Cochrane Systematic Review","authors":"Phil Edwards, Chloe Perkins","doi":"10.1186/s12874-024-02332-0","DOIUrl":null,"url":null,"abstract":"A decade ago paper questionnaires were more common in epidemiology than those administered online, but increasing Internet access may have changed this. Researchers planning to use a self-administered questionnaire should know whether response rates to questionnaires administered electronically differ to those of questionnaires administered by post. We analysed trials included in a recently updated Cochrane Review to answer this question. We exported data of randomised controlled trials included in three comparisons in the Cochrane Review that had evaluated hypotheses relevant to our research objective and imported them into Stata for a series of meta-analyses not conducted in the Cochrane review. We pooled odds ratios for response using random effects meta-analyses. We explored causes of heterogeneity among study results using subgroups. We assessed evidence for reporting bias using Harbord’s modified test for small-study effects. Twenty-seven trials (66,118 participants) evaluated the effect on response of an electronic questionnaire compared with postal. Results were heterogeneous (I-squared = 98%). There was evidence for biased (greater) effect estimates in studies at high risk of bias; A synthesis of studies at low risk of bias indicates that response was increased (OR = 1.43; 95% CI 1.08–1.89) using postal questionnaires. Ten trials (39,523 participants) evaluated the effect of providing a choice of mode (postal or electronic) compared to an electronic questionnaire only. Response was increased with a choice of mode (OR = 1.63; 95% CI 1.18–2.26). Eight trials (20,909 participants) evaluated the effect of a choice of mode (electronic or postal) compared to a postal questionnaire only. There was no evidence for an effect on response of a choice of mode compared with postal only (OR = 0.94; 95% CI 0.86–1.02). Postal questionnaires should be used in preference to, or offered in addition to, electronic modes.","PeriodicalId":9114,"journal":{"name":"BMC Medical Research Methodology","volume":"49 1","pages":""},"PeriodicalIF":3.9000,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Research Methodology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12874-024-02332-0","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}

引用次数: 0

Abstract

A decade ago paper questionnaires were more common in epidemiology than those administered online, but increasing Internet access may have changed this. Researchers planning to use a self-administered questionnaire should know whether response rates to questionnaires administered electronically differ to those of questionnaires administered by post. We analysed trials included in a recently updated Cochrane Review to answer this question. We exported data of randomised controlled trials included in three comparisons in the Cochrane Review that had evaluated hypotheses relevant to our research objective and imported them into Stata for a series of meta-analyses not conducted in the Cochrane review. We pooled odds ratios for response using random effects meta-analyses. We explored causes of heterogeneity among study results using subgroups. We assessed evidence for reporting bias using Harbord’s modified test for small-study effects. Twenty-seven trials (66,118 participants) evaluated the effect on response of an electronic questionnaire compared with postal. Results were heterogeneous (I-squared = 98%). There was evidence for biased (greater) effect estimates in studies at high risk of bias; A synthesis of studies at low risk of bias indicates that response was increased (OR = 1.43; 95% CI 1.08–1.89) using postal questionnaires. Ten trials (39,523 participants) evaluated the effect of providing a choice of mode (postal or electronic) compared to an electronic questionnaire only. Response was increased with a choice of mode (OR = 1.63; 95% CI 1.18–2.26). Eight trials (20,909 participants) evaluated the effect of a choice of mode (electronic or postal) compared to a postal questionnaire only. There was no evidence for an effect on response of a choice of mode compared with postal only (OR = 0.94; 95% CI 0.86–1.02). Postal questionnaires should be used in preference to, or offered in addition to, electronic modes.

查看原文本刊更多论文

使用邮寄问卷而非电子问卷可提高回复率--最新 Cochrane 系统综述的新结果

十年前，纸质问卷在流行病学中比在线问卷更常见，但互联网接入的不断增加可能已经改变了这一状况。计划使用自填式问卷的研究人员应该了解电子问卷的回复率与邮寄问卷的回复率是否存在差异。为了回答这个问题，我们分析了最近更新的 Cochrane 综述中所包含的试验。我们导出了 Cochrane 综述中三项比较试验中包含的随机对照试验数据，这些试验评估了与我们的研究目标相关的假设，我们将这些数据导入到 Stata 中，进行了一系列 Cochrane 综述中未进行的荟萃分析。我们使用随机效应荟萃分析对反应的几率比进行了汇总。我们通过分组探讨了研究结果之间存在异质性的原因。我们使用哈伯德修正的小规模研究效应检验法评估了报告偏倚的证据。27项试验（66118名参与者）评估了电子问卷与邮寄问卷相比对回复率的影响。结果不尽相同（I 方 = 98%）。有证据表明，在偏倚风险较高的研究中，效果估计值存在偏倚（较大）；对偏倚风险较低的研究进行的综合分析表明，使用邮寄问卷的应答率有所提高（OR = 1.43; 95% CI 1.08-1.89）。十项试验（39,523 名参与者）评估了提供方式选择（邮寄或电子）与仅提供电子问卷的效果。选择调查方式可提高回复率（OR = 1.63；95% CI 1.18-2.26）。八项试验（20,909 名参与者）评估了与仅使用邮寄问卷相比，选择电子问卷或邮寄问卷的效果。没有证据表明，与仅采用邮寄方式相比，选择电子或邮寄方式会对回复率产生影响（OR = 0.94; 95% CI 0.86-1.02）。邮寄问卷应优先于电子问卷，或作为电子问卷的补充。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

BMC Medical Research Methodology 医学-卫生保健

CiteScore

6.50

自引率

2.50%

发文量

298

审稿时长

3-8 weeks

期刊介绍： BMC Medical Research Methodology is an open access journal publishing original peer-reviewed research articles in methodological approaches to healthcare research. Articles on the methodology of epidemiological research, clinical trials and meta-analysis/systematic review are particularly encouraged, as are empirical studies of the associations between choice of methodology and study outcomes. BMC Medical Research Methodology does not aim to publish articles describing scientific methods or techniques: these should be directed to the BMC journal covering the relevant biomedical subject area.