Journal of applied measurement最新文献

筛选
英文 中文
Detecting Rater Effects under Rating Designs with Varying Levels of Missingness. 在不同缺失程度的评分设计下检测评分者效应。
Journal of applied measurement Pub Date : 2018-01-01
Rose E Stafford, Edward W Wolfe, Jodi M Casablanca, Tian Song
{"title":"Detecting Rater Effects under Rating Designs with Varying Levels of Missingness.","authors":"Rose E Stafford,&nbsp;Edward W Wolfe,&nbsp;Jodi M Casablanca,&nbsp;Tian Song","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Previous research has shown that indices obtained from partial credit model (PCM) estimates can detect severity and centrality rater effects, though it remains unknown how rater effect detection is impacted by the missingness inherent in double-scoring rating designs. This simulation study evaluated the impact of missing data on rater severity and centrality detection. Data were generated for each rater effect type, which varied in rater pool quality, rater effect prevalence and magnitude, and extent of missingness. Raters were flagged using rater location as a severity indicator and the standard deviation of rater thresholds a centrality indicator. Two methods of identifying extreme scores on these indices were compared. Results indicate that both methods result in low Type I and Type II error rates (i.e., incorrectly flagging non-effect raters and not flagging effect raters) and that the presence of missing data has negligible impact on the detection of severe and central raters.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"19 3","pages":"243-257"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"36451138","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Measuring the Impact of Caring for a Spouse with Alzheimer's Disease: Validation of the Alzheimer's Patient Partners Life Impact Questionnaire (APPLIQue). 衡量照顾患有阿尔茨海默病的配偶的影响:阿尔茨海默病患者伴侣生活影响问卷(APPLIQue)的验证。
Journal of applied measurement Pub Date : 2018-01-01
Peter Hagell, Matthew Rouse, Stephen P McKenna
{"title":"Measuring the Impact of Caring for a Spouse with Alzheimer's Disease: Validation of the Alzheimer's Patient Partners Life Impact Questionnaire (APPLIQue).","authors":"Peter Hagell,&nbsp;Matthew Rouse,&nbsp;Stephen P McKenna","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Alzheimer's disease (AD) is the most common form of dementia, characterized by cognitive, psychiatric and behavioral symptoms and increasing dependency. Family members typically assume increasing caregiving responsibilities, with considerable quality of life (QoL) impact. This article describes the testing of a needs-based QoL questionnaire for AD family caregivers. Initial analyses, according to Rasch measurement theory, suggested that items applied to spousal rather than non-spousal caregivers. Following removal of non-spousal responders, a 25-item questionnaire was identified that exhibited acceptable model fit, a mean (SD) person location of 0.194 (1.42) logits, residual correlations 0.173 and absence of DIF by age, gender or administration. Reliability was 0.85. This new measure, the Alzheimer's Patient Partners Life Impact Questionnaire (APPLIQue), may fill an important gap in assessing the impact of AD on spousal caregivers and outcomes of interventions aimed at caregivers as well as persons with AD.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"19 3","pages":"271-282"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"36451688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Validation Instrument to Evaluate Students' Perception of Virtual Manipulatives in Learning Mathematics. 评估学生在数学学习中对虚拟教具认知的验证工具。
Journal of applied measurement Pub Date : 2018-01-01
Fereshteh Zeynivandnezhad
{"title":"Validation Instrument to Evaluate Students' Perception of Virtual Manipulatives in Learning Mathematics.","authors":"Fereshteh Zeynivandnezhad","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The advent of new technologies has replaced physical manipulatives - which are physical models of equivalent representation of concepts by virtual manipulatives which many learners and teachers find useful in the mathematics classroom. The current study investigated students' motivation to engage with virtual manipulatives as a tool in the mathematics education. Activity theory was used to conduct a multicomponential survey of virtual manipulatives in education and administered it to 442 Iranian high school students with the aim of examining students' perception of various aspects of the manipulatives. Using the Rasch-Andrich rating scale model (RSM), an item response theory model, psychometric features of the instrument were examined item endorsibility, learners' ability, fit, and unidimensionality. The validated instrument can be used to find the factors that could improve students' perceptions of virtual manipulatives in the mathematics classroom.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"19 4","pages":"387-412"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"36729344","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessment of Test Items with Rasch Measurement Model. 用Rasch测量模型评价测试项目。
Journal of applied measurement Pub Date : 2018-01-01
Patrick U Osadebe
{"title":"Assessment of Test Items with Rasch Measurement Model.","authors":"Patrick U Osadebe","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The study was carried out to assess the difficulty index of each item of an Economics Achievement test with the Rasch model. The infit and outfit as well as the reliability of the test were determined. Three research questions were drawn to guide the study. A sample of 200 was randomly selected using simple random sampling of balloting and proportionate stratified random sampling. The instrument of the study was an Economics Achievement Test with 100 items. The test has face and content validities. It has a reliability coefficient of 0.86 established through the use of Kuder-Richardson 20 method. A Rasch model software of Winsteps version 3.75 was used to analyse the data collected. The result identified the difficulty index of each item. The infit and outfit of both MNSQ and ZSTD were determined. The reliability of the Economics Achievement Test was estimated. It was recommended among others that Rasch model should always be used in assessing the item difficulty of a test and ensure the stability of item parameters.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"19 1","pages":"106-112"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35932179","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Methods for the Comparison of Differential Item Functioning across Assessments. 跨评估的差异项目功能比较方法。
Journal of applied measurement Pub Date : 2018-01-01
W Holmes Finch, Maria Hernandez Finch, Brian F French, David E McIntosh, Lauren Moss
{"title":"Methods for the Comparison of Differential Item Functioning across Assessments.","authors":"W Holmes Finch,&nbsp;Maria Hernandez Finch,&nbsp;Brian F French,&nbsp;David E McIntosh,&nbsp;Lauren Moss","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>An important aspect of the educational and psychological evaluation of individuals is the selection of scales with appropriate evidence of reliability and validity for inferences and uses of the scores for the population of interest. One key aspect of validity is the degree to which a scale fairly assesses the construct(s) of interest for members of different subgroups within the population. Typically, this issue is addressed statistically through assessment of differential item functioning (DIF) of individual items, or differential test functioning (DTF) of sets of items within the same measure. When selecting an assessment to use for a given application (e.g., measuring intelligence), or which form of an assessment to use for a test administration, researchers need to consider the extent to which the scales work with all members of the population. Little research has examined methods for comparing the amount or magnitude of DIF/DTF present in two or more assessments when deciding which assessment to use. The current study made use of 7 different statistics for this purpose, in the context of intelligence testing. Results demonstrate that by using a variety of effect sizes, the researcher can gain insights into not only which scales may contain the least amount of DTF, but also how they differ with regard to the way in which the DTF manifests itself.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"19 1","pages":"26-40"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"35932757","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparing Disability Levels for Community-dwelling Adults in the United States and the Republic of Korea using the Rasch Model. 用Rasch模型比较美国和韩国社区居住成年人的残疾水平。
Journal of applied measurement Pub Date : 2018-01-01
Ickpyo Hong, Annie N Simpson, Kit N Simpson, Sandra S Brotherton, Craig A Velozo
{"title":"Comparing Disability Levels for Community-dwelling Adults in the United States and the Republic of Korea using the Rasch Model.","authors":"Ickpyo Hong,&nbsp;Annie N Simpson,&nbsp;Kit N Simpson,&nbsp;Sandra S Brotherton,&nbsp;Craig A Velozo","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>This study compared disability levels between community-dwelling adults in the United States and South Korea using two national surveys of the United States and Korean National Health and Examination Survey (NHANES and KNHANES). The Rasch common-item equating method was used to create the same measurement framework and compared average disability levels. The disability levels between the two countries were estimated using the current disability estimation method (percentage of people having disability based on a single question). A higher percentage of American adults (20.5%) showed disability than the Korean adults (9.6%) based on the current estimation method; however, using the Rasch model American adults had significantly less disability (Mean = -3.00 logits, SD = 1.67) than the Korean adults (Mean = -2.48 logits, SD = 2.13). Complementary to comparisons of the frequency of disability, comparison of the combined magnitude and strength of disability across countries provides new information that may better inform public health and policy decisions.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"19 2","pages":"114-128"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"36216475","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation of Self-management Program Outcomes: Adaptation and Testing of a Swedish Version of the Health Education Impact Questionnaire (heiQ). 自我管理计划结果的评估:瑞典版健康教育影响问卷(heiQ)的适应和测试。
Journal of applied measurement Pub Date : 2018-01-01
Christine Kumlien, Michael Miller, Cecilia Fagerstrom, Peter Hagell
{"title":"Evaluation of Self-management Program Outcomes: Adaptation and Testing of a Swedish Version of the Health Education Impact Questionnaire (heiQ).","authors":"Christine Kumlien,&nbsp;Michael Miller,&nbsp;Cecilia Fagerstrom,&nbsp;Peter Hagell","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Self-management programs require a range of indicators to evaluate their outcomes. The Health Education Impact Questionnaire (heiQ) was developed to meet this need. The heiQ contains 40 items with 4 response categories, representing eight scales. We developed a Swedish version of the heiQ that was tested by cognitive interviews (n = 15) and psychometrically (n = 177) using classical test theory (CTT) and Rasch measurement theory (RMT). The Swedish heiQ was easily understood by interviewees and met CTT criteria, with supported scaling assumptions (corrected item-total correlations, 0.37) and reliability (ordinal alpha 0.78). General support was demonstrated for the measurement properties of the eight heiQ scales by acceptable RMT fit. However, there were signs of malfunctioning response categories for four items in two scales, and of suboptimal item coverage of the measurement continua. The Swedish heiQ appears comparable to other available language versions. Further efforts may be needed to optimize response categories and measurement precision.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"19 3","pages":"303-319"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"36451141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Psychometric Properties of an Instrument to Measure Word Problem Solving Skills in Mathematics. 一种测量数学中文字问题解决能力的工具的心理测量特性。
Journal of applied measurement Pub Date : 2018-01-01
Chunlian Jiang, Do-Hong Kim, Chuang Wang
{"title":"Psychometric Properties of an Instrument to Measure Word Problem Solving Skills in Mathematics.","authors":"Chunlian Jiang,&nbsp;Do-Hong Kim,&nbsp;Chuang Wang","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>The purpose of this study is to examine the psychometric properties of an instrument to measure word problem solving skills in mathematics related to speed with 706 sixth grade Chinese and Singaporean students. Rasch measurement models were applied to examine the reliability, unidimensionality, rating scale functioning, item difficulty, and person difficulty. The differential item functioning (DIF) analysis was also performed to examine the differences in item difficulty estimates between Chinese and Singaporean students. Results suggest that the data satisfied the unidimensionality requirements of the Rasch model and that most of the item difficulty measures aligned the person ability distribution. The instrument demonstrated adequate reliability. The fit statistics were within acceptable limits for the vast majority of items, with a few exceptions. The rating scale structure functioned properly although the middle categories had very few observations. Deleting misfitting cases and collapsing middle categories slightly improved the psychometric properties. DIF analysis revealed that four items were more difficult for Chinese students whereas two other items were more difficult for the Singaporean students. Results also indicated that the Chinese participants scored higher than the Singaporean participants for 11 of the 14 items and the Singaporean students scored higher than their Chinese cohorts in the other 3 items. The validation of this instrument has implications for the teaching and learning of mathematical word problems in practice.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"19 3","pages":"283-302"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"36451690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Factor Structure of the Community Reintegration of Service-Members (CRIS) in Veterans with Blast-Related Mild Traumatic Brain Injury. 爆炸相关轻度创伤性脑损伤退伍军人社区重返社会的因素结构
Journal of applied measurement Pub Date : 2018-01-01
J Kay Waid-Ebbs, Pey-Shan Wen, David P Graham, Kathleen Ray, Audrey J Leroux, Maureen K O'Connor, Drew Helmer
{"title":"Factor Structure of the Community Reintegration of Service-Members (CRIS) in Veterans with Blast-Related Mild Traumatic Brain Injury.","authors":"J Kay Waid-Ebbs,&nbsp;Pey-Shan Wen,&nbsp;David P Graham,&nbsp;Kathleen Ray,&nbsp;Audrey J Leroux,&nbsp;Maureen K O'Connor,&nbsp;Drew Helmer","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Veterans with blast-related mild traumatic brain injury (mTBI) report difficulty engaging in life roles, also referred to as participation. Current measures are either global or lack comprehensive coverage of life roles and have not been validated in Veterans with mTBI. The Community Reintegration of Service-members instrument (CRIS) is a promising measure that was specifically developed for Veterans using a well-formulated conceptual framework and Rasch analysis. However, the CRIS has not been validated in Veterans with mTBI. Two data sets were combined for 191 Veterans with blast-related mTBI to conduct a confirmatory factor analysis of the CRIS. High residual and low loading items (33) were removed to improve the model fit. The remaining items demonstrated high correlation (0.87-0.89) between subscales and high test re-test (0.85 to 0.95). Mean scores were better for Veterans without Post Traumatic Stress Disorder (PTSD) or depression compared to Veterans with PTSD or depression. The refined CRIS offers a valid comprehensive measure of participation for Veterans with blast-related mTBI. Future directions include examining aspects of participation that may not be covered by the CRIS for Veterans with mTBI..</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"19 4","pages":"363-369"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"36668564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Examination of Item Quality in a State-Wide Music Assessment Program using Rasch Methodology. 使用Rasch方法在全国音乐评估项目中检查项目质量。
Journal of applied measurement Pub Date : 2018-01-01
Yin Burgess, Jin Liu, Mihaela Ene
{"title":"Examination of Item Quality in a State-Wide Music Assessment Program using Rasch Methodology.","authors":"Yin Burgess,&nbsp;Jin Liu,&nbsp;Mihaela Ene","doi":"","DOIUrl":"","url":null,"abstract":"<p><p>Students' academic performance has been routinely assessed in various subjects, including arts education. The current study uses Rasch methodology to investigate item quality for an annual state-wide arts assessment program administered to 4th grade students. All multiple-choice items were previously analyzed through the true score theory (TST) framework to examine item difficulty, differential item functioning (DIF), and distractor quality. However, these traditional methods are sample-specific, and score interpretations are limited to the particular group being tested. Rasch methodology provides a sample-free framework for item analysis. This approach has the advantage of producing sample-invariant item parameters and using goodness-of-fit criteria to detect problematic items, leading to more accurate item analysis results. Study results suggest that majority of the items performed well and the test was appropriate to its intended audience and evaluation purpose. It also validates the test score interpretation and the use of this assessment program.</p>","PeriodicalId":73608,"journal":{"name":"Journal of applied measurement","volume":"19 4","pages":"370-386"},"PeriodicalIF":0.0,"publicationDate":"2018-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"36668565","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信