Survey practicePub Date : 2024-01-18DOI: 10.29115/sp-2023-0030
Alexandra K. Murphy, Alix Gould-Werth, Jamie Griffin
{"title":"Using a split-ballot design to validate an abbreviated categorical measurement scale: An illustration using the Transportation Security Index","authors":"Alexandra K. Murphy, Alix Gould-Werth, Jamie Griffin","doi":"10.29115/sp-2023-0030","DOIUrl":"https://doi.org/10.29115/sp-2023-0030","url":null,"abstract":"To address the high survey costs and increased respondent burden that comes with administering composite multi-item scales, researchers frequently seek to develop and use abbreviated scales. To help them do so, methodologists have issued a series of guidelines outlining best practices for shortening scales. However, it is difficult to find an empirical illustration of both the design and validation of an abbreviated scale, particularly one for which the classification of respondents into distinct categories is of paramount importance. In this paper, we present such an illustration using the Transportation Security Index (TSI) as a motivating example. Notably, we employ a split-ballot experiment to validate the TSI-6, a six-item abbreviated scale that successfully reproduces the original, validated TSI-16. We also illustrate the implementation of several agreed upon best practices in abbreviated scale development and propose and demonstrate specific steps that are uniquely relevant to the validation of a categorical abbreviated measure.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"113 25","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139615542","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2024-01-04DOI: 10.29115/sp-2023-0019
Zoe Padgett, Sam Gutierrez, Laura Wronski, Soubhik Barari
{"title":"Measuring the Growth of Gender-Inclusive Surveys Around the World","authors":"Zoe Padgett, Sam Gutierrez, Laura Wronski, Soubhik Barari","doi":"10.29115/sp-2023-0019","DOIUrl":"https://doi.org/10.29115/sp-2023-0019","url":null,"abstract":"As ideas about gender identity evolve, survey researchers around the world are working to understand how best to measure sex and gender in a way that is both accurate and inclusive. Emerging best practices differ widely between countries based on cultural and societal norms and the construction of language around gender. In this paper, we examine how survey creators have changed how they ask about gender in the past decade across 11 linguistically and culturally diverse countries. We measure the number of answer options included in gender questions created by SurveyMonkey users between 2012 and 2022. Our findings show that the number of gender questions with more than two answer options increased in all countries examined in our research. Canada, the United Kingdom, and Australia show the highest levels of gender questions with more than two answer options in 2022, while Egypt and Nigeria have the lowest levels.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"62 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139386908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2024-01-01DOI: 10.29115/sp-2024-0014
Nicole A Cummings, Joy E Onukwufor, Brian W Ward, Sonja N Williams
{"title":"Use of a Set-up Fee to Encourage Survey Participation and Electronic Health Record Submission for a National Health Care Survey.","authors":"Nicole A Cummings, Joy E Onukwufor, Brian W Ward, Sonja N Williams","doi":"10.29115/sp-2024-0014","DOIUrl":"10.29115/sp-2024-0014","url":null,"abstract":"<p><p>In 2021, the National Ambulatory Medical Care Survey Health Center (NAMCS HC) Component modernized its data collection and began collecting clinical visit data from health centers using transmission of electronic health record (EHR) data. With this redesign, there are potential cost implications for a health center to participate. Beginning in 2021, a one-time set-up fee (i.e., payment) of up to $10,000 was offered to centers who participated in the NAMCS HC Component. Starting in 2022, a Set-up Fee Questionnaire was used to capture data on the use of this money. Results show on average the fee appeared adequate in covering participation costs, with the fee most often used to cover costs of health center and EHR vendor information technology staff. Although this fee was offered only during the initial year of participation, retention rates for centers appeared high. Implications from the findings of this case study on use of a set-up fee in establishment surveys are also briefly discussed.</p>","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"17 1","pages":"1-11"},"PeriodicalIF":0.0,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11497862/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142514385","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2023-12-21DOI: 10.29115/sp-2023-0025
Michael Soszynski, Ryan Bliss
{"title":"Survey Mode and Item Non-Substantive Response: Insights from a Replication Study and Other Recent Trials","authors":"Michael Soszynski, Ryan Bliss","doi":"10.29115/sp-2023-0025","DOIUrl":"https://doi.org/10.29115/sp-2023-0025","url":null,"abstract":"This is a replication of a Survey Practice article that was published in September 2022 that explored survey administration mode and non-substantive response. It revisits the findings from the first study using a randomized controlled design. In this study, we found that on average phone respondents provided more non-substantive responses than web survey respondents, though the portion of phone and web respondents with one or more non-substantive response was similar. Another paper we published in Survey Practice in 2023 also explored mode effects with random assignment to text-to-web and phone groups. Thus, this is the third article by the authors on this topic released in Survey Practice. As part of this paper, we discuss findings from all three articles and contextualize them in relationship to other research on item non-substantive response and survey mode (specifically web and phone).","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"26 26","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138950418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2023-11-30DOI: 10.29115/sp-2023-0020
Martha Kovac, Nancy Clusen, Jared Coopersmith, Nadia Bell, Emily Newton-Hoe
{"title":"Developing a Sample Frame from Multiple Sample Frame Sources and Fielding a Survey to State and City Leaders","authors":"Martha Kovac, Nancy Clusen, Jared Coopersmith, Nadia Bell, Emily Newton-Hoe","doi":"10.29115/sp-2023-0020","DOIUrl":"https://doi.org/10.29115/sp-2023-0020","url":null,"abstract":"A critical driver of population health, well-being, and equity is making health a shared value, or the belief that health is a priority for oneself and one’s community. For people in positions of influence, attitudes regarding their organization’s perspective may result in decisions that advance health equity or reinforce inequities, yet little is known about leaders’ attitudes regarding their organization’s perspective on what shapes health, or how their attitudes translate into actions that improve population health. We conducted a mixed-mode survey from fall 2020 to spring 2022. The objectives of the survey were (1) to understand leaders’ attitudes regarding their organization’s perspective on population health and (2) to identify the attitudes associated with leaders’ perspectives regarding their organization’s intention to engage in behaviors that advance population health. Findings from this survey will fill the gaps in the evidence base regarding what people in positions of influence think about social determinants of health and health equity, as well as their attitudes regarding their organization’s perspective. A major challenge for the study was identifying the sample frame, meant to provide a list of all U.S. leaders at the city and state level covering ten sectors. We identified five sample frame sources from which we pulled and constructed a sample frame. We sampled 17,400 organizations and obtained completed surveys from 5,450 leaders, achieving a 32 percent response rate. We used the best sample frame sources we knew of to develop our sample frame. The percent of contact information we obtained from the five sample frame sources was high, and rates of ineligibility were low. Response rates varied widely by sector. Survey respondents tended to be slightly more male and very slightly more White compared to the full eligible sample, and more liberal than the general population.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"37 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139200362","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2023-11-16DOI: 10.29115/sp-2023-0023
Mario Callegaro, Ana Villar Casas
{"title":"Recent Books and Journal Articles in Public Opinion, Survey Methods, Survey Statistics, Big Data, Data Science, and User Experience Research. 2021 Update","authors":"Mario Callegaro, Ana Villar Casas","doi":"10.29115/sp-2023-0023","DOIUrl":"https://doi.org/10.29115/sp-2023-0023","url":null,"abstract":"","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"1 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139269078","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2023-11-09DOI: 10.29115/sp-2023-0021
Dan Cassino
{"title":"Symposium on Adding a Middle Eastern or North African category to the US Census","authors":"Dan Cassino","doi":"10.29115/sp-2023-0021","DOIUrl":"https://doi.org/10.29115/sp-2023-0021","url":null,"abstract":"","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":" 38","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135293247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2023-11-09DOI: 10.29115/sp-2023-0027
Andrew A. Beveridge, Margo Anderson
{"title":"Proposed Changes in Federally Mandated Race and Ethnic Classifications May Undermine Their Original Purpose","authors":"Andrew A. Beveridge, Margo Anderson","doi":"10.29115/sp-2023-0027","DOIUrl":"https://doi.org/10.29115/sp-2023-0027","url":null,"abstract":"The Office of Management and Budget (OMB) is proposing an overhaul of “Statistical Policy Directive 15,” commonly referred to informally as OMB15 , the mandated method for collecting data on and classifying the race and ethnic status of the American population. Initiated in 1977, the standards for collecting data on race and ethnicity are mandated to be used by the Census Bureau and all federal agencies, and eventually all state, local, and private entities that receive federal funds, and/or come under civil rights compliance provisions designed to monitor disparities and correct discrimination. The classification was developed to monitor compliance with several civil rights laws affecting many sectors of American life that were passed in the 1960s and in later years. The widespread use and enormous implications of changes in how the United States collects race and ethnicity data mean that we should be very cautious about changes like the ones that have been proposed, and we think it would be wise to make these mandated data classifications both as simple as possible for the U.S. population to understand their meaning and to apply them in the many areas where they are to be used.","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"29 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139281852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Survey practicePub Date : 2023-11-09DOI: 10.29115/sp-2023-0028
Sarah Abboud
{"title":"Inclusion of the MENA Category in the U.S. Census: Will MENA Individuals and Their Health Disparities be Finally Visible?","authors":"Sarah Abboud","doi":"10.29115/sp-2023-0028","DOIUrl":"https://doi.org/10.29115/sp-2023-0028","url":null,"abstract":"Adding a Middle Eastern and North African (MENA) category to the United States (U.S.) Census is necessary to identify the barriers that MENA Americans face, and the first step in eliminating them. In the U.S., racial and ethnic categories have shifted significantly throughout history to accommodate the constant changes in the demographic makeup and the sociopolitical climate of the country. The racial and ethnic classification of individuals in the U.S. reflects the type of services, fundings, and opportunities (e.g., economic, educational, health, housing) that a person can benefit from. Beyond providing population data, Census results dictate the annual distribution of more than $675 billion in federal funds. But because they have been classified as White in the U.S. Census, residents who trace their ancestry to the Middle East and North Africa region have historically experienced systematic invisibility that became central to their daily lives (Abboud et al., 2019).","PeriodicalId":74893,"journal":{"name":"Survey practice","volume":"2 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139282193","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}