Survey practice最新文献

{"title":"The effect of a web-push survey on physician survey response rates: a randomized experiment.","authors":"C. Delnevo, Binu Singh","doi":"10.21203/rs.2.12242/v1","DOIUrl":"https://doi.org/10.21203/rs.2.12242/v1","url":null,"abstract":"\u0000 Background: Achieving a high response rate for physicians has been challenging and with response rates declining in recent years, innovative methods are needed to increase rates. An emerging concept in survey methodology has been web-push survey delivery. In this delivery method, contact is made by mail to request a response by web. This study explored the feasibility of a web-push survey on a national sample of physicians.\u0000Methods: 1000 physicians across six specialties were randomly assigned to a mail only or web-push survey delivery. Each mode consisted of four contacts including an initial mailing, reminder postcard, and two additional follow-ups. Response rates were calculated using AAPOR’s response rate 3 calculation. Data collection occurred between Febuary – April 2018 and analyzed March 2019.\u0000Results: Overall reponse rates for the mail only vs. web-push survey delivery were comparable (51.2% vs. 52.8%). Higher response rates across all demographics were seen in the web-push delivery with the exception of pulmonary/critical care and physicians over the age of 65. The web-push survey yielded a greater response after the first mailing requiring fewer follow-up contacts resulting in a more cost-effective delivery.\u0000Conclusions: A web-push mail survey is effective in achieveing a comparable response rate to traditional mail only delivery for physicians. The web-push survey was more efficient in terms of cost and in receiving responses in a more timely manner. Future research should explore the efficiency of a web-push survey delivery across various health care provider populations.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"77 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"67946184","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Effects of Push-To-Web Mixed Mode Approaches on Survey Response Rates: Evidence from a Randomized Experiment in Emergency Departments","authors":"L. Parast, Megan Mathews, M. Elliott, Anagha Tolpadi, Elizabeth Flow-Delwiche, William G. Lehrman, Debra S. Stark, Kirsten M. Becker","doi":"10.29115/SP-2019-0008","DOIUrl":"https://doi.org/10.29115/SP-2019-0008","url":null,"abstract":"Recent work involving survey administration among emergency department (ED) patients has demonstrated very low response rates using single-mode (e.g., mail-only or web-only) approaches. In this study, the authors tested several mixed-mode protocols that focus on a push-to-web approach for survey administration in this challenging but important setting. A random sample of 26,991 ED discharged-to-community (DTC) patients discharged in January 2018–March 2018 from 16 hospital-based EDs nationwide were randomized to nine survey arms, eight of which involved a web survey with one or more of the following methods of invitation to the web survey: an emailed link to the web survey, a texted link to the web survey, and/or a mailed paper invitation with information on how to access the web survey. The reference arm was standard mixed mode (mailed survey with telephone follow-up). Invitation(s) to the web survey was followed by (1) a mailed survey, (2) telephone follow-up, or (3) both. The overall response rate across all arms was 18.6% (American Association for Public Opinion Research [AAPOR] RR1). None of the tested web-survey arms had significantly higher response rates than standard mixed mode (25.5%). Protocol comparisons demonstrated that both text outreach and including a telephone mode increased response rates. When examining response by completion mode, the arms involving text invitation had a higher percentage of completed surveys that were completed by web than arms not involving text invitation. Characteristics (e.g., age) of telephone and web respondents were more representative of the sampled population than mail respondents. Older patients and male patients were significantly less likely to be reachable by email or text. These results demonstrate that sequential multi-mode approaches involving web, mail, and telephone with multiple methods of web survey invitation show the greatest promise for obtaining higher response rates and more representative respondents from the ED population.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45649079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Methods for Improving Response Rates in an Emergency Department Setting – A Randomized Feasibility Study","authors":"Megan Mathews, L. Parast, Anagha Tolpadi, M. Elliott, Elizabeth Flow-Delwiche, Kirsten M. Becker","doi":"10.29115/SP-2019-0007","DOIUrl":"https://doi.org/10.29115/SP-2019-0007","url":null,"abstract":"Standard single survey mode approaches, such as mail-only or telephone-only, generally produce lower response rates than sequential mixed mode (SMM) approaches. SMM approaches may be particularly important when lower response propensities and/or poor contact information exist, as with emergency department (ED) patients. Results were examined from a randomized feasibility study testing five survey administration modes among ED patients who are discharged-to-community. A total of 4,017 discharged patients from eight EDs during February 2016 were randomized in equal numbers to five modes: on-site distribution of a paper survey; mail notification of a web survey; email notification of a web survey; two-stage SMM (mailed survey with telephone follow-up); and three-stage SMM (email notification of a web survey with mail follow-up and then telephone follow-up). Sampled patients received a 43-item instrument focusing on ED patient experience. The two-stage SMM, commonly used for other patient experience surveys, was the reference mode. Three-stage SMM had a higher response rate (30.7%) than two-stage SMM (25.3%); the other three experimental modes had significantly lower response rates (0.8–9.6%; p<0.001 for all comparisons). On-site distribution was difficult to operationalize, possibly promoting selection bias. Valid email capture rates ranged from 4.0% to 48.3% by hospital and 30.1% overall, even though participating hospitals reported capture rates of at least 20%; the odds of having a valid email address were significantly lower for older and male patients. Findings highlight the limitations of web-only and on-site approaches, and identify SMM with a web-based component as a promising approach for survey administration in the ED setting.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42020958","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"“Your Survey is Biased”: A Preliminary Investigation into Respondent Perceptions of Survey Bias","authors":"Adam Mayer","doi":"10.29115/SP-2019-0005","DOIUrl":"https://doi.org/10.29115/SP-2019-0005","url":null,"abstract":"Collecting survey data has become more resource-intensive as response rates have declined. Contemporaneous to the decline in response rates has been a growing distrust in science among the general public in nations such as the United States. The authors suggest that this decline in trust has implications for survey data collection, in that some respondents state that surveys on contentious topics are “biased.” In this paper, the authors present preliminary qualitative and quantitative data to understand the extent and origins of perceptions of survey bias. The authors conclude with suggestions for future research to further understand this problem and develop ameliorative strategies.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49078521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Computing “e” in Self-Administered Address-Based Sampling Studies","authors":"J. DeMatteis","doi":"10.29115/SP-2019-0002","DOIUrl":"https://doi.org/10.29115/SP-2019-0002","url":null,"abstract":"In recent years, address-based sampling (ABS) has become a widely used approach for obtaining samples for household surveys in the United States. In computing response rates for self-administered ABS studies, one challenge is in estimating the eligibility rate of sampled cases with unknown eligibility, denoted e in American Association for Public Opinion Research response rate calculations RR3 and RR4. The assumptions underlying standard approaches for estimating e are unlikely to hold in self-administered ABS studies. This note describes an approach for estimating e in such situations.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"35 12","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41303716","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Willingness of Online Respondents to Participate in Alternative Modes of Data Collection","authors":"J. Mulder, M. D. Bruijne","doi":"10.29115/SP-2019-0001","DOIUrl":"https://doi.org/10.29115/SP-2019-0001","url":null,"abstract":"This study investigates online respondents’ willingness to participate in research when using alternative data collection modes and techniques. The study compares mail surveys; face-to-face surveys; telephone interviews; and data collection techniques using apps, wearables, and register data. We also investigate whether respondents find certain topics relatively attractive to have measured in an alternative way compared to surveys. The results are based on a probability-based sample of about 2,000 Dutch respondents. The findings help to decide when to use different data collection methods for the social sciences. The results also provide insights into which respondents require extra persuasion to participate when new data collection modes are used.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46250981","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Geographic Inaccuracy of Cellphone Samples","authors":"Stephanie Marken, M. Chattopadhyay, A. Cahn","doi":"10.29115/SP-2018-0037","DOIUrl":"https://doi.org/10.29115/SP-2018-0037","url":null,"abstract":"The geographic accuracy provided in cellphone samples has been an issue of particular concern for telephone surveys. Surveyors use this information for geographic sample stratification and analysis; however, the location generated using random digit dialing (RDD) methods is typically the rate center in which the phone was activated and not the owner’s current residence. Researchers have found the location is fairly accurate at the regional (census region) level. However, the error rate increases when moving to the state and local levels. Cellphone error rates are higher among ‘cell-only’ (cellphone users who do not have a landline telephone) respondents than for ‘dual-users’ (cellphone users who have a cellphone and landline telephone). Among respondents sampled from the landline frame, the error rate (difference between location on the sample file and current location of residence) is smaller. Past research estimates the state error rate is about 1% for a landline sample and 12% for the ‘cell-only’ group (Skalland and Khare 2013). This paper builds upon previous research by providing state level estimates of inaccuracy for both ‘cell-only’ and ‘dual-users.’ It also examines the trend of state-level inaccuracy estimates over 18 months using data from the Gallup Daily Tracking survey. Finally, we examine the characteristics of ‘cell-only’ and ‘dual-users’ and implications of geographic inaccuracy of cellphone samples on the state level dual-frame RDD estimates.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44303209","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Estimation of Survey Cost Parameters Using Paradata","authors":"J. Wagner","doi":"10.29115/SP-2018-0036","DOIUrl":"https://doi.org/10.29115/SP-2018-0036","url":null,"abstract":"In many survey situations, detailed cost parameters are difficult to estimate. This is especially true in surveys involving interviewers. Overall costs may be easily estimated since interviewer hours, materials, and incentives are relatively easy to track. But costs at a more granular level – for example, hours spent travelling, identifying non-sample units, or engaged in other activities -- may be difficult to track. This occurs for a number of reasons. Often, cost information and paradata are collected in separate systems; or the cost information that is collected may not be at a sufficiently detailed level in order to evaluate the costs of particular subtasks. It might be possible to gather these cost data via a special study, but this is usually a very expensive approach. It may also be possible to ask for more detailed reporting from interviewers and other staff. However, this approach might lead to reduced efficiency. This paper proposes the use of regression models estimated from paradata as a method for estimating detailed cost parameters related to interviewer effort. An example of this method is shown from the National Survey of Family Growth 2011-2018. This method was used to evaluate the costs of two treatment arms in an experimental study. The method is also used to monitor interviewer effort over the course of the field period.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43122025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Professional Association and Pathways to Leadership in Our Profession","authors":"M. Sha","doi":"10.29115/SP-2018-0039","DOIUrl":"https://doi.org/10.29115/SP-2018-0039","url":null,"abstract":"The 2019 Interview with the Expert Series starts with a conversation between Courtney Kennedy and Mandy Sha on the topic of pathways to leadership in our profession. Courtney is the chief methodologist at a leading fact tank and chairs the 2019 AAPOR conference. Mandy has 20 years of experience in commercial and noncommercial sectors as well as a university survey shop, and will chair the 2020 AAPOR conference. Drawing upon their own successes and challenges, they provided pragmatic suggestions to early and mid-career professionals who would like to transition into leaders and influencers. Specifically, they talked about leveraging professional association membership in the American Association for Public Opinion Research (AAPOR).","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47756269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Text Mining in Survey Data","authors":"Christine P Chai","doi":"10.29115/SP-2018-0035","DOIUrl":"https://doi.org/10.29115/SP-2018-0035","url":null,"abstract":"Free text responses in surveys contain important information and should be analyzed by researchers. However, human coding of survey text is not only expensive, but also vulnerable to subjectivity. An automated text mining approach can solve these problems. Therefore, we demonstrate using the supervised latent Dirichlet allocation (sLDA) to jointly analyze text and numerical data in an employee satisfaction survey. For each rating, the algorithm outputs selected words as the “topic” and estimates the credible interval. Finally, we discuss future applications and advantages of utilizing survey text.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45583125","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}