{"title":"Constructing an Outcome Measure of Occupational Experience: An Application of Rasch Measurement Methods.","authors":"Brett Berg, Karen Atler, Anne G Fisher","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Rasch methods were used to evaluate and further develop the Daily Experiences of Pleasure, Productivity, and Restoration Profile (PPR Profile) into a health outcome measure of occupational experience. Analyses of 263 participant PPR Profiles focused on rating scale structure, dimensionality, and reliability. All rating scale categories increased with the intended meaning of the scales, but only 20 of the 21 category measures fit the Rasch rating scale model (RRSM). Several items also did not fit the RRSM and results of residual principal components analyses suggested possible second dimensions in each scale. More importantly, reliability coefficients were very low and participants could not be separated into more than one group as demonstrated by low person separation indices. The authors offer several recommendations for the next steps in the development of the PPR Profile as a health outcome measure of occupational experience.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"18 1","pages":"1-11"},"PeriodicalIF":0.0,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"34950742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rose E Stafford, Christopher R Runyon, Jodi M Casabianca, Barbara G Dodd
{"title":"Comparing Imputation Methods for Trait Estimation Using the Rating Scale Model.","authors":"Rose E Stafford, Christopher R Runyon, Jodi M Casabianca, Barbara G Dodd","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>This study examined the performance of four methods of handling missing data for discrete response options on a questionnaire: (1) ignoring the missingness (using only the observed items to estimate trait levels); (2) nearest-neighbor hot deck imputation; (3) multiple hot deck imputation; and (4) semi-parametric multiple imputation. A simulation study examining three questionnaire lengths (41-, 20-, and 10-item) crossed with three levels of missingness (10, 25, and 40 percent) was conducted to see which methods best recovered trait estimates when data were missing completely at random and the polytomous items were scored with Andrich's (1978) rating scale model. The results showed that ignoring the missingness and semi-parametric imputation best recovered known trait levels across all conditions, with the semi-parametric technique providing the most precise trait estimates. This study demonstrates the power of specific objectivity in Rasch measurement, as ignoring the missingness leads to generally unbiased trait estimates.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"18 1","pages":"12-27"},"PeriodicalIF":0.0,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"34950743","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Factorial and Item-Level Invariance of a Principal Perspectives Survey: German and U.S. Principals.","authors":"Chuang Wang, Dawson R Hancock, Ulrich Muller","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>This study examined the factorial and item-level invariance of a survey of principals' job satisfaction and perspectives about reasons and barriers to becoming a principal with a sample of US principals and another sample of German principals. Confirmatory factor analysis (CFA) and differential item functioning (DIF) analysis were employed at the test and item level, respectively. A single group CFA was conducted first, and the model was found to fit the data collected. The factorial invariance between the German and the US principals was tested through three steps: (a) configural invariance; (b) measurement invariance; and (c) structural invariance. The results suggest that the survey is a viable measure of principals' job satisfaction and perspectives about reasons and barriers to becoming a principal because principals from two different cultures shared a similar pattern on all three constructs. The DIF analysis further revealed that 22 out of the 28 items functioned similarly between German and US principals.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"18 2","pages":"215-227"},"PeriodicalIF":0.0,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35454491","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Approximate Functional Relationship between IRT and CTT Item Discrimination Indices: A Simulation, Validation, and Practical Extension of Lord's (1980) Formula.","authors":"John T Kulas, Jeffrey A Smith, Hui Xu","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Lord (1980) presented a purely conceptual equation to approximate the nonlinear functional relationship between classical test theory (CTT; aka true score theory) and item response theory (IRT) item discrimination indices. The current project proposes a modification to his equation that makes it useful in practice. The suggested modification acknowledges the more common contemporary CTT discrimination index of a corrected item-total correlation and incorporates item difficulty. We simulated slightly over 768 trillion individual item responses to uncover a best-fitting empirical function relating the IRT and CTT discrimination indices. To evaluate the effectiveness of the function, we applied it to real-world test data from 16 workforce and educational tests. Our modification results in shifted functional asymptotes, slopes, and points of inflection across item difficulties. Validation with the workforce and educational tests suggests good prediction under common assumption testing conditions (approximately normal distribution of abilities and moderate item difficulties) and greater precision than Lord's (1980) formula.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"18 4","pages":"393-407"},"PeriodicalIF":0.0,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35666122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Rasch Analysis of a Behavioral Checklist for the Assessment of Pain in Critically Ill Adults.","authors":"Christophe Chenier, Gilles Raiche, Nadine Talbot, Bianca Carignan, Celine Gelinas","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Patients hospitalized in the intensive care unit (ICU) are often unable to report their pain, which is a problem since untreated pain is associated with negative health outcomes. The use of behavioral pain scales are recommended for the detection of the presence of pain in this vulnerable population. Previous validation studies have used classical techniques, and several psychometrics properties remain unknown. In this paper, data obtained from a behavioral checklist of dichotomized items was utilized to evaluate the instrument's dimensionality, its construct validity and its capacity to distinguish between levels of pain by using Rasch measurement. A sample of 239 ICU patients was used to collect the data. Results showed that, while unidimensionality was acceptable, concerns remained about the local independence and item fit indices. A third of the items showed misfit. Finally, while items had a great reliability (0.97), persons' measures had a rather low reliability (0.62) and only 1.28 strata of pain could be distinguished. The narrow range of pain levels in the sample could explain this poor performance and further study is needed, with a sample exhibiting a wider range of pain levels.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"18 1","pages":"28-42"},"PeriodicalIF":0.0,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"34950744","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Angela Robertson, David T Morse, Kristina Hood, Courtney Walker
{"title":"Measuring Alcohol Marketing Engagement: The Development and Psychometric Properties of the Alcohol Marketing Engagement Scale.","authors":"Angela Robertson, David T Morse, Kristina Hood, Courtney Walker","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Ample evidence exists in support of the influence of media, both traditional and electronic, on perceptions and engagement with alcohol marketing. We describe the development, calibration, and evidence for technical quality and utility for a new measure, the Alcohol Marketing Engagement Scale. Using two samples of college undergraduates (n1 = 199, n2 = 732), we collected field test responses to a total of 13 items. Initial support for scale validity is presented via correlations with attributes previously shown to be related to alcohol engagement. While the joint map of estimated scale locations of items and respondents indicates the need for further scale development, the results of the present analyses are promising. Implications for use in research are discussed.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"18 1","pages":"87-99"},"PeriodicalIF":0.0,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"34951166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Infit and Outfit: Interpreting Statistical Significance and Magnitude of Misfit in Conjunction.","authors":"Christine E DeMars","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>In many areas of statistics it is common practice to present both a statistical significance test and an effect size. In contrast, for the Infit and Outfit indices of item misfit, it has historically been common to focus on either the mean square (MS; an index of the magnitude of misfit) or the statistical significance, but not both. If the statistical significance and effect size are to be used together, it is important not only that the Type I error rate matches the nominal alpha level, but also that, for any given magnitude of misfit, the expected value of the MS is independent of sample size. This study confirmed that the average MS for several simulated misfitting items was nearly the same for large and small samples, although necessarily the variance depended on sample size. Thus, if the item fit is statistically significant, the MS appears to be a reasonable index for judging the magnitude of the misfit in the sample, although one must recognize that the estimate of the magnitude will be less stable in small samples, as is true for all effect sizes.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"18 2","pages":"163-177"},"PeriodicalIF":0.0,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35454486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sara M Locatelli, Lisa K Sharp, Saming T Syed, Shikhi Bhansari, Ben S Gerber
{"title":"Measuring Health-related Transportation Barriers in Urban Settings.","authors":"Sara M Locatelli, Lisa K Sharp, Saming T Syed, Shikhi Bhansari, Ben S Gerber","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Access to reliable transportation is important for people with chronic diseases considering the need for frequent medical visits and for medications from the pharmacy. Understanding of the extent to which transportation barriers, including lack of transportation, contribute to poor health outcomes has been hindered by a lack of consistency in measuring or operationally defining \"transportation barriers.\" The current study uses the Rasch measurement model to examine the psychometric properties of a new measure designed to capture types of transportation and associated barriers within an urban context. Two hundred forty-four adults with type 2 diabetes were recruited from within an academic medical center in Chicago and completed the newly developed transportation questions as part of a larger National Institutes of Health funded study (ClinicalTrials.gov identifier: NCT01498159). Results suggested a two subscale structure that reflected 1) general transportation barriers and 2) public transportation barriers.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"18 2","pages":"178-193"},"PeriodicalIF":0.0,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5704937/pdf/nihms920901.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35454487","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ahmad Zamri Khairani, Nor Shafrin Ahmad, Mohd Zahuri Khairani
{"title":"Measuring Anger Types among Malaysian Adolescents using the Rasch Model.","authors":"Ahmad Zamri Khairani, Nor Shafrin Ahmad, Mohd Zahuri Khairani","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Adolescences is an important transitional phase in human development where they experience physiological as well as psychological changes. Nevertheless, these changes are often understood by teachers, parents, and even the adolescents themselves. Thus, conflicts exist and adolescents are affected from the conflict physically and emotionally. An important state of emotions that result from this conflict is anger. This article describes the development and validation of the 34-item Adolescent Anger Inventory (AAI) to measure types of anger among Malaysian adolescents. A sample of 2,834 adolescents in secondary school who provide responses that were analyzed using Rasch model measurement framework. The 4 response category worked satisfactorily for the scale developed. A total of 11 items did not fit to the model's expectations, and thus dropped from the final scale. The scale also demonstrated satisfactory reliability and separation evidence. Also, items in the AAI depicted no evidence of DIF between 14- and 16-year-old adolescents. Nevertheless, the AAI did not have sufficient items to target adolescents with a high level of physical aggressive anger.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"18 4","pages":"449-458"},"PeriodicalIF":0.0,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35665986","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Effects of Item Placement in the Young Schema Questionnaire.","authors":"Ida Marais, Victoria K Moir, Christopher W Lee","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The Young Schema Questionnaire (YSQ) was developed to measure Early Maladaptive Schemas (EMS), a construct central to Schema Therapy (ST). Traditionally YSQ items were placed in a grouped format for each schema but in recent versions of the questionnaire, items are presented in a random order. This study investigates the effect of item placement on the psychometric properties of the questionnaire. On different occasions, participants completed two versions of the YSQ short form, one with items grouped according to schemas and another where items were placed in a random order. Responses were analysed using the polytomous Rasch model of measurement (partial credit parameterization). Results show that the two versions are not psychometrically equivalent. There were greater differences between the clinical and non-clinical group means for the grouped format than the random format and greater person separation. There was more response dependence between items in the grouped format which has been linked to inflated reliability indices.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"18 4","pages":"370-382"},"PeriodicalIF":0.0,"publicationDate":"2017-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35666120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}