Educational Measurement-Issues and Practice最新文献

筛选
英文 中文
Investigating Approaches to Controlling Item Position Effects in Computerized Adaptive Tests
IF 2.7 4区 教育学
Educational Measurement-Issues and Practice Pub Date : 2024-10-27 DOI: 10.1111/emip.12637
Ye Ma, Deborah J. Harris
{"title":"Investigating Approaches to Controlling Item Position Effects in Computerized Adaptive Tests","authors":"Ye Ma,&nbsp;Deborah J. Harris","doi":"10.1111/emip.12637","DOIUrl":"https://doi.org/10.1111/emip.12637","url":null,"abstract":"<p>Item position effect (IPE) refers to situations where an item performs differently when it is administered in different positions on a test. The majority of previous research studies have focused on investigating IPE under linear testing. There is a lack of IPE research under adaptive testing. In addition, the existence of IPE might violate Item Response Theory (IRT)’s item parameter invariance assumption, which facilitates applications of IRT in various psychometric tasks such as computerized adaptive testing (CAT). Ignoring IPE might lead to issues such as inaccurate ability estimation in CAT. This article extends research on IPE by proposing and evaluating approaches to controlling position effects under an item-level computerized adaptive test via a simulation study. The results show that adjusting IPE via a pretesting design (approach 3) or a pool design (approach 4) results in better ability estimation accuracy compared to no adjustment (baseline approach) and item-level adjustment (approach 2). Practical implications of each approach as well as future research directions are discussed as well.</p>","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"44 1","pages":"44-54"},"PeriodicalIF":2.7,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143424315","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Digital Module 36: Applying Intersectionality Theory to Educational Measurement 数字模块 36:在教育测量中应用交叉性理论
IF 2.7 4区 教育学
Educational Measurement-Issues and Practice Pub Date : 2024-10-09 DOI: 10.1111/emip.12622
Michael Russell
{"title":"Digital Module 36: Applying Intersectionality Theory to Educational Measurement","authors":"Michael Russell","doi":"10.1111/emip.12622","DOIUrl":"https://doi.org/10.1111/emip.12622","url":null,"abstract":"<div>\u0000 \u0000 <section>\u0000 \u0000 <h3> Module Abstract</h3>\u0000 \u0000 <p>Over the past decade, interest in applying Intersectionality Theory to quantitative analyses has grown. This module examines key concepts that form the foundation of Intersectionality Theory and considers challenges and opportunities these concepts present for quantitative methods. Two examples are presented to demonstrate how an intersectional approach to quantitative analyses differs from a traditional single-axis approach. The first example employs a linear regression technique to examine the efficacy of an educational intervention and to explore whether efficacy differs among subgroups of students. The second example compares findings when a differential item function analysis is conducted in a single-axis manner versus an intersectional lens. The module ends by exploring key considerations analysts and psychometricians encounter when applying Intersectionality Theory to a quantitative analysis.</p>\u0000 </section>\u0000 </div>","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"43 3","pages":"106-108"},"PeriodicalIF":2.7,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/emip.12622","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142404751","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On the Cover: Gendered Trajectories of Digital Literacy Development: Insights from a Longitudinal Cohort Study 封面上:数字素养发展的性别轨迹:纵向队列研究的启示
IF 2.7 4区 教育学
Educational Measurement-Issues and Practice Pub Date : 2024-10-09 DOI: 10.1111/emip.12625
Yuan-Ling Liaw
{"title":"On the Cover: Gendered Trajectories of Digital Literacy Development: Insights from a Longitudinal Cohort Study","authors":"Yuan-Ling Liaw","doi":"10.1111/emip.12625","DOIUrl":"https://doi.org/10.1111/emip.12625","url":null,"abstract":"","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"43 3","pages":"6"},"PeriodicalIF":2.7,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/emip.12625","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142404750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Demystifying Adequate Growth Percentiles
IF 2.7 4区 教育学
Educational Measurement-Issues and Practice Pub Date : 2024-10-09 DOI: 10.1111/emip.12635
Katherine E. Castellano, Daniel F. McCaffrey, Joseph A. Martineau
{"title":"Demystifying Adequate Growth Percentiles","authors":"Katherine E. Castellano,&nbsp;Daniel F. McCaffrey,&nbsp;Joseph A. Martineau","doi":"10.1111/emip.12635","DOIUrl":"https://doi.org/10.1111/emip.12635","url":null,"abstract":"<p>Growth-to-standard models evaluate student growth against the growth needed to reach a future standard or target of interest, such as proficiency. A common growth-to-standard model involves comparing the popular Student Growth Percentile (SGP) to Adequate Growth Percentiles (AGPs). AGPs follow from an involved process based on fitting a series of nonlinear quantile regression models to longitudinal student test score data. This paper demystifies AGPs by deriving them in the more familiar linear regression framework. It further shows that unlike SGPs, AGPs and on-track classifications based on AGPs are strongly related to status. Lastly, AGPs are evaluated in terms of their classification accuracy. An empirical study and analytic derivations reveal AGPs can be problematic indicators of students’ future performance with previously not proficient students being more likely incorrectly flagged as not on-track and previously proficient students as on track. These classification errors have equity implications at the individual and school levels.</p>","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"44 1","pages":"31-43"},"PeriodicalIF":2.7,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143423664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Issue Cover 发行封面
IF 2.7 4区 教育学
Educational Measurement-Issues and Practice Pub Date : 2024-10-09 DOI: 10.1111/emip.12564
{"title":"Issue Cover","authors":"","doi":"10.1111/emip.12564","DOIUrl":"https://doi.org/10.1111/emip.12564","url":null,"abstract":"","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"43 3","pages":""},"PeriodicalIF":2.7,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/emip.12564","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142404260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Examining the Psychometric Impact of Targeted and Random Double-Scoring in Mixed-Format Assessments
IF 2.7 4区 教育学
Educational Measurement-Issues and Practice Pub Date : 2024-10-01 DOI: 10.1111/emip.12636
Yangmeng Xu, Stefanie A. Wind
{"title":"Examining the Psychometric Impact of Targeted and Random Double-Scoring in Mixed-Format Assessments","authors":"Yangmeng Xu,&nbsp;Stefanie A. Wind","doi":"10.1111/emip.12636","DOIUrl":"https://doi.org/10.1111/emip.12636","url":null,"abstract":"<p>Double-scoring constructed-response items is a common but costly practice in mixed-format assessments. This study explored the impacts of Targeted Double-Scoring (TDS) and random double-scoring procedures on the quality of psychometric outcomes, including student achievement estimates, person fit, and student classifications under various conditions that reflect operational performance assessments. Using a simulation study, our results suggest no notable advantages for TDS over the random double-scoring approach across various psychometric outcomes, regardless of conditions related to student misfit, rater misfit, and rater severity. This study holds significant implications for mixed-format assessments, offering insights into a comprehensive evaluation of double-scoring methods. We recommend that researchers consider these findings when considering among double-scoring procedures.</p>","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"44 1","pages":"18-30"},"PeriodicalIF":2.7,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143424018","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Commentary: What Is the Breadth of “Educational Measurement?” 评论:什么是 "教育测量 "的广度?
IF 2.7 4区 教育学
Educational Measurement-Issues and Practice Pub Date : 2024-09-16 DOI: 10.1111/emip.12627
Marjorie Wine, Alexander M. Hoffman
{"title":"Commentary: What Is the Breadth of “Educational Measurement?”","authors":"Marjorie Wine,&nbsp;Alexander M. Hoffman","doi":"10.1111/emip.12627","DOIUrl":"https://doi.org/10.1111/emip.12627","url":null,"abstract":"<p>The work of educational measurement is a highly collaborative endeavor that brings together professionals from many disciplines. While the introduction of the “Foundational Competencies in Educational Measurement” acknowledges this, the explanation of the framework itself falls short in acknowledging the competencies and skills of those from disciplines other than psychometrics, such as content development professionals (CDPs). Therefore, it is unable to sufficiently address the nature of validation work or other work not led by psychometricians. It also underexplores the vital competencies that underlie effective collaboration. As a result, it defines the competencies of psychometric work instead of the larger field of educational measurement.</p>","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"43 3","pages":"23-26"},"PeriodicalIF":2.7,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142404726","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Commentary: What Is Truly Foundational? 评论:什么是真正的基础?
IF 2.7 4区 教育学
Educational Measurement-Issues and Practice Pub Date : 2024-09-12 DOI: 10.1111/emip.12633
Eduardo J. Crespo Cruz, Aria Immanuel, Lisa A. Keller,  Ketan, Kimberly McIntee, Fernando José Mena Serrano, Stephen G. Sireci, Nate Smith, Javier Suárez-Álvarez, Craig S. Wells, Rebecca Woodland, April L. Zenisky
{"title":"Commentary: What Is Truly Foundational?","authors":"Eduardo J. Crespo Cruz,&nbsp;Aria Immanuel,&nbsp;Lisa A. Keller,&nbsp; Ketan,&nbsp;Kimberly McIntee,&nbsp;Fernando José Mena Serrano,&nbsp;Stephen G. Sireci,&nbsp;Nate Smith,&nbsp;Javier Suárez-Álvarez,&nbsp;Craig S. Wells,&nbsp;Rebecca Woodland,&nbsp;April L. Zenisky","doi":"10.1111/emip.12633","DOIUrl":"https://doi.org/10.1111/emip.12633","url":null,"abstract":"<p>The Task Force on Foundational Competencies in Educational Measurement has produced a set of foundational competencies and invited comment on the document. The students and faculty at the University of Massachusetts Amherst provide their comments and critique of the proposed competencies. Both students and faculty agree that there needs to be more specificity regarding the purpose of the document, the nature of the data used to produce the document, and the definition of the relevant terms. Additionally, attention should be paid to the international context, and the role of artificial intelligence and machine learning. The authors acknowledge the contribution of the draft of the foundational competencies and look forward to more conversation regarding this topic.</p>","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"43 3","pages":"52-55"},"PeriodicalIF":2.7,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142404651","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Past, Present, and Future of Large-Scale Assessment Consortia 大规模评估联盟的过去、现在和未来
IF 2.7 4区 教育学
Educational Measurement-Issues and Practice Pub Date : 2024-09-11 DOI: 10.1111/emip.12634
Derek C. Briggs
{"title":"The Past, Present, and Future of Large-Scale Assessment Consortia","authors":"Derek C. Briggs","doi":"10.1111/emip.12634","DOIUrl":"10.1111/emip.12634","url":null,"abstract":"<p>This article provides a history of the two large-scale assessment consortia that were funded in 2010 as part of the Race to the Top Competition, the Partnership for the Assessment of Readiness for College and Career (PARCC), and the Smarter-Balanced Assessment Consortium (SBAC). I compare the goals the consortia were funded to meet between 2011 and 2015 with the assessment systems PARCC and SBAC were able to deliver. Two notable accomplishments of both consortia were the development of high-quality summative assessments that were carefully designed to be accessible to all test-takers. I describe factors that led many states to withdraw from consortia membership between 2011 and 2015, and which led to the effective dissolution of PARCC. I discuss lessons learned from serving on the PARCC and SBAC technical advisory committees, and make a case for the value proposition of assessment consortia in the future.</p>","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"43 4","pages":"62-72"},"PeriodicalIF":2.7,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142211655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Commentary: Where Does Classroom Assessment Fit in Educational Measurement? 评论:课堂评估在教育测量中的地位?
IF 2.7 4区 教育学
Educational Measurement-Issues and Practice Pub Date : 2024-08-26 DOI: 10.1111/emip.12626
Susan M. Brookhart
{"title":"Commentary: Where Does Classroom Assessment Fit in Educational Measurement?","authors":"Susan M. Brookhart","doi":"10.1111/emip.12626","DOIUrl":"10.1111/emip.12626","url":null,"abstract":"<p>This article is a commentary on the Foundational Competencies in Educational Measurement (Ackerman et al., 2024, hereafter the FCs) through the lens of classroom assessment. I focus on the place of classroom assessment in the FCs and in NCME and educational measurement more broadly.</p>","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"43 3","pages":"18-22"},"PeriodicalIF":2.7,"publicationDate":"2024-08-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142211654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信