Educational Assessment最新文献

筛选
英文 中文
The Impact of Disengaged Test Taking on a State’s Accountability Test Results 不参与考试对州问责制考试结果的影响
IF 1.5
Educational Assessment Pub Date : 2021-07-03 DOI: 10.1080/10627197.2021.1956897
S. Wise, Sukkeun Im, Jay Lee
{"title":"The Impact of Disengaged Test Taking on a State’s Accountability Test Results","authors":"S. Wise, Sukkeun Im, Jay Lee","doi":"10.1080/10627197.2021.1956897","DOIUrl":"https://doi.org/10.1080/10627197.2021.1956897","url":null,"abstract":"ABSTRACT This study investigated test-taking engagement on the Spring 2019 administration of a large-scale state summative assessment. Through the identification of rapid-guessing behavior – which is a validated indicator of disengagement – the percentage of Grade 8 test events with meaningful amounts of rapid guessing was 5.5% in mathematics, 6.7% in English Language Arts (ELA), and 3.5% in science. Disengagement rates on the state summative test were also found to vary materially across gender, ethnicity, Individualized Educational Plan (IEP) status, Limited English Proficient (LEP) status, free and reduced lunch (FRL) status, and disability status. However, school mean performance, proficiency rates, and relative ranking were only minimally affected by disengagement. Overall, results of this study indicate that disengagement has a material impact on individual state summative test scores, though its impact on score aggregations may be relatively minor.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"26 1","pages":"163 - 174"},"PeriodicalIF":1.5,"publicationDate":"2021-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/10627197.2021.1956897","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45119734","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Assessing Quality of Teaching from Different Perspectives: Measurement Invariance across Teachers and Classes 从不同角度评估教学质量:教师和班级之间的测量不变性
IF 1.5
Educational Assessment Pub Date : 2021-04-03 DOI: 10.1080/10627197.2020.1858785
G. Krammer, Barbara Pflanzl, Gerlinde Lenske, Johannes Mayr
{"title":"Assessing Quality of Teaching from Different Perspectives: Measurement Invariance across Teachers and Classes","authors":"G. Krammer, Barbara Pflanzl, Gerlinde Lenske, Johannes Mayr","doi":"10.1080/10627197.2020.1858785","DOIUrl":"https://doi.org/10.1080/10627197.2020.1858785","url":null,"abstract":"ABSTRACT Comparing teachers’ self-assessment to classes’ assessment of quality of teaching can offer insights for educational research and be a valuable resource for teachers’ continuous professional development. However, the quality of teaching needs to be measured in the same way across perspectives for this comparison to be meaningful. We used data from 622 teachers self-assessing aspects of quality of teaching and of their classes (12229 students) assessing the same aspects. Perspectives were compared with measurement invariance analyses. Teachers and classes agreed on the average level of instructional clarity, and disagreed over teacher-student relationship and performance monitoring, suggesting that mean differences across perspectives may not be as consistent as the literature claims. Results showed a nonuniform measurement bias for only one item of instructional clarity, while measurement of the other aspects was directly comparable. We conclude the viability of comparing teachers’ and classes’ perspectives of aspects of quality of teaching.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"26 1","pages":"88 - 103"},"PeriodicalIF":1.5,"publicationDate":"2021-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/10627197.2020.1858785","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42517403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Predicting Retention in Higher Education from high-stakes Exams or School GPA 从高风险考试或学校平均成绩预测高等教育的保留率
IF 1.5
Educational Assessment Pub Date : 2021-02-06 DOI: 10.1080/10627197.2022.2130748
M. Meeter, M. V. van Brederode
{"title":"Predicting Retention in Higher Education from high-stakes Exams or School GPA","authors":"M. Meeter, M. V. van Brederode","doi":"10.1080/10627197.2022.2130748","DOIUrl":"https://doi.org/10.1080/10627197.2022.2130748","url":null,"abstract":"ABSTRACT The transition from secondary to tertiary education varies from country to country. In many countries, secondary school is concluded with high-stakes, national exams, or high-stakes entry tests are used for admissions to tertiary education. In other countries, secondary-school grade point average (GPA) is the determining factor. In the Netherlands, both play a role. With administrative data of close to 180,000 students, we investigated whether national exam scores or secondary school GPA was a better predictor of tertiary first-year retention. For both university education and higher professional education, secondary school GPA was the better prediction of retention, to the extent that national exams did not explain any additional variance. Moreover, for students who failed their exam, being held back by the secondary school for an additional year and entering tertiary education one year later, GPA in the year of failure remained as predictive as for students who had passed their exams and started tertiary education immediately. National exam scores, on the other hand, had no predictive value at all for these students. It is concluded that secondary school GPA measures aspects of student performance that is not included in high-stakes national exams, but that are predictive of subsequent success in tertiary education.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"28 1","pages":"1 - 10"},"PeriodicalIF":1.5,"publicationDate":"2021-02-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42962496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Do They See What I See? Toward a Better Understanding of the 7Cs Framework of Teaching Effectiveness 他们看到我看到的了吗?更好地理解7Cs教学有效性框架
IF 1.5
Educational Assessment Pub Date : 2021-01-05 DOI: 10.1080/10627197.2020.1858784
S. Phillips, Ronald F. Ferguson, Jacob F. S. Rowley
{"title":"Do They See What I See? Toward a Better Understanding of the 7Cs Framework of Teaching Effectiveness","authors":"S. Phillips, Ronald F. Ferguson, Jacob F. S. Rowley","doi":"10.1080/10627197.2020.1858784","DOIUrl":"https://doi.org/10.1080/10627197.2020.1858784","url":null,"abstract":"ABSTRACT School systems are increasingly incorporating student perceptions of teaching effectiveness into educator accountability systems. Using Tripod’s 7Cs™ Framework of Teaching Effectiveness, this study examines key issues in validating student perception data for use in this manner. Analyses examine the internal structure of 7Cs scores and the extent to which scores predict key criteria. Results offer the first empirical evidence that 7Cs scores capture seven distinct dimensions of teaching effectiveness even as they also confirm prior research concluding 7Cs scores are largely unidimensional. At the same time, results demonstrate a modest relationship between 7Cs scores and teacher self-assessments of their own effectiveness. Together, findings suggest 7Cs scores can be used to collect meaningful information about over-arching effectiveness. However, additional evidence is warranted before giving 7Cs scores as much weight in high-stakes contexts as value-added test-score gains or expert classroom observations.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"26 1","pages":"69 - 87"},"PeriodicalIF":1.5,"publicationDate":"2021-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/10627197.2020.1858784","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48730441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
The Effect of Linguistic Factors on Assessment of English Language Learners’ Mathematical Ability: A Differential Item Functioning Analysis 语言因素对英语学习者数学能力评价的影响——差异项功能分析
IF 1.5
Educational Assessment Pub Date : 2020-12-17 DOI: 10.1080/10627197.2020.1858783
Stephanie Buono, E. Jang
{"title":"The Effect of Linguistic Factors on Assessment of English Language Learners’ Mathematical Ability: A Differential Item Functioning Analysis","authors":"Stephanie Buono, E. Jang","doi":"10.1080/10627197.2020.1858783","DOIUrl":"https://doi.org/10.1080/10627197.2020.1858783","url":null,"abstract":"ABSTRACT Increasing linguistic diversity in classrooms has led researchers to examine the validity and fairness of standardized achievement tests, specifically concerning whether test score interpretations are free of bias and score use is fair for all students. This study examined whether mathematics achievement test items that contain complex language function differently between two language subgroups: native English speakers (EL1, n= 1 000), and English language learners (ELL, n= 1 000). Confirmatory Differential Item Functioning (DIF) analyses using a SIBTEST were performed on 28 mathematics assessment items. Eleven items were identified to have complex language features, and DIF analyses revealed that seven of these items (63%) favored EL1s over ELLs. Effect sizes were moderate (0.05 ≤ <0.10) for six items, and marginal ( <0.05) for one item. This paper discusses validity issues with math achievement test items assessing ELLs and calls for careful test development and instructional accommodation in the classroom.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"26 1","pages":"125 - 144"},"PeriodicalIF":1.5,"publicationDate":"2020-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/10627197.2020.1858783","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49511402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
The Road to Retention Passes through First Year Academic Performance: A Meta-Analytic Path Analysis of Academic Performance and Persistence 留任之路通过第一年的学习成绩:学习成绩与坚持的元分析路径分析
IF 1.5
Educational Assessment Pub Date : 2020-12-12 DOI: 10.1080/10627197.2020.1848423
Paul A. Westrick, F. Schmidt, Huy Le, S. Robbins, Justine Radunzel
{"title":"The Road to Retention Passes through First Year Academic Performance: A Meta-Analytic Path Analysis of Academic Performance and Persistence","authors":"Paul A. Westrick, F. Schmidt, Huy Le, S. Robbins, Justine Radunzel","doi":"10.1080/10627197.2020.1848423","DOIUrl":"https://doi.org/10.1080/10627197.2020.1848423","url":null,"abstract":"ABSTRACT This meta-analytic path analysis presents evidence that first-year academic performance (FYAP), measured by first-year grade point average (FYGPA) plays the major role in determining second-year student retention and that socioeconomic status (SES), measured by parental income, plays a negligible role. Based on large sample data used in a previous study, we conducted additional analyses that included corrections for measurement error and created path models using precollege academic achievement, measured by ACT Composite scores and high school GPA (HSGPA), and SES to predict FYAP and then second-year retention. Precollege academic performances had direct effects on FYAP, and FYAP fully mediated their effects on second-year retention. SES did not contribute to the prediction of FYAP, and it had only a trivial effect on second-year retention. The results of this study point to the criticality of FYAP, and supporting first-year student academic success may serve as the central vehicle for retention efforts.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"26 1","pages":"35 - 51"},"PeriodicalIF":1.5,"publicationDate":"2020-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/10627197.2020.1848423","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46352124","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
A Confirmatory Item Factor Analysis of A School Climate Measure for Adolescents with and without Disabilities 残疾青少年和非残疾青少年学校气氛测量的验证性项目因素分析
IF 1.5
Educational Assessment Pub Date : 2020-11-19 DOI: 10.1080/10627197.2020.1841625
Graham G. Rifenbark, Allison R. Lombardi, Jennifer Freeman
{"title":"A Confirmatory Item Factor Analysis of A School Climate Measure for Adolescents with and without Disabilities","authors":"Graham G. Rifenbark, Allison R. Lombardi, Jennifer Freeman","doi":"10.1080/10627197.2020.1841625","DOIUrl":"https://doi.org/10.1080/10627197.2020.1841625","url":null,"abstract":"ABSTRACT In this study (n = 5037) we further investigated the construct validity of the Georgia Brief School Climate Inventory (GBS). Despite containing ordinal items (e.g., ordered-responses), the GBS has only been examined using linear approaches. To fill this void, we employed confirmatory item factor analysis (IFA) to examine the factor structure because the observed data are polytomous. Using response data from adolescents with (n = 784) and without (n = 4253) disabilities in urban and suburban high schools, we tested for measurement invariance by estimating a series of multiple-group IFA models and examined the relationship between school climate and academic achievement. The study findings promote the use of non-linear methods for analyzing ordered response data and further support the importance of prioritizing students with disabilities in school climate studies.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"26 1","pages":"52 - 68"},"PeriodicalIF":1.5,"publicationDate":"2020-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/10627197.2020.1841625","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48364105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Using an Index of Admission Obstacles with Constrained Optimization to Increase the Diversity of College Classes 利用约束优化的录取障碍指数提高大学班级多样性
IF 1.5
Educational Assessment Pub Date : 2020-11-05 DOI: 10.1080/10627197.2020.1841626
R. Zwick, A. Blatter, Lei Ye, Steven P. Isham
{"title":"Using an Index of Admission Obstacles with Constrained Optimization to Increase the Diversity of College Classes","authors":"R. Zwick, A. Blatter, Lei Ye, Steven P. Isham","doi":"10.1080/10627197.2020.1841626","DOIUrl":"https://doi.org/10.1080/10627197.2020.1841626","url":null,"abstract":"ABSTRACT Today, postsecondary institutions in the US typically wish to enroll entering classes that are both academically qualified and diverse. Although the definition of diversity varies from school to school, the challenge is essentially the same: How can academic objectives be combined with goals that involve the composition of the entering class? Many schools have a commitment to facilitating access for under-represented minorities or low-income applicants, or for members of nearby communities. Incorporating these goals while maintaining academic standards can be challenging.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"26 1","pages":"20 - 34"},"PeriodicalIF":1.5,"publicationDate":"2020-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/10627197.2020.1841626","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48905544","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Getting the Emphasis Right: Formative Assessment through Professional Learning 正确把握重点:通过专业学习进行形成性评估
IF 1.5
Educational Assessment Pub Date : 2020-10-01 DOI: 10.1080/10627197.2020.1766959
M. Heritage
{"title":"Getting the Emphasis Right: Formative Assessment through Professional Learning","authors":"M. Heritage","doi":"10.1080/10627197.2020.1766959","DOIUrl":"https://doi.org/10.1080/10627197.2020.1766959","url":null,"abstract":"ABSTRACT This concluding essay offers a reflection on the set of the papers contained in this special issue of the Educational Assessment journal. In it the author situates formative assessment squarely in the realm of teachers’ continuous professional learning and considers the essential nature of formative assessment as centering on three questions that guide the practice for both teachers and students: where are the students going (well-defined learning goals), where are they currently (evidence collected during the course of learning), and how to close the gap between these two (instructional adjustments, feedback, and student involvement)? The author returns at the end to note the importance of professional learning in the context of formative assessment.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"25 1","pages":"355 - 358"},"PeriodicalIF":1.5,"publicationDate":"2020-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/10627197.2020.1766959","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42350019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
How Do Proficient and Less Proficient Students Differ in Their Composition Processes? 熟练和不熟练的学生在写作过程中有什么不同?
IF 1.5
Educational Assessment Pub Date : 2020-07-02 DOI: 10.1080/10627197.2020.1804351
R. Bennett, Mo Zhang, P. Deane, P. V. van Rijn
{"title":"How Do Proficient and Less Proficient Students Differ in Their Composition Processes?","authors":"R. Bennett, Mo Zhang, P. Deane, P. V. van Rijn","doi":"10.1080/10627197.2020.1804351","DOIUrl":"https://doi.org/10.1080/10627197.2020.1804351","url":null,"abstract":"ABSTRACT We evaluate how higher- vs. lower-scoring middle-school students differ in their composition processes when writing persuasive essays from source materials. We examined differences on four individual process features–time taken before beginning to write, typing speed, total time spent, and number of words started. Next, we examined differences for four aggregated process measures: fluency, local editing, macro editing, and interstitial pausing (suspending text entry at locations associated with planning). Results showed that higher vs. lower scoring students were most consistently differentiated by total time, number of words started, and fluency. These differences persisted across two persuasive subgenres and two proficiency criteria, essay score and English language arts total-test score. The study’s findings give a more complete picture of how the processes employed by more- and less-successful students differ, which contributes to cognitive writing theory and may have eventual implications for education policy and instructional practice.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"25 1","pages":"198 - 217"},"PeriodicalIF":1.5,"publicationDate":"2020-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/10627197.2020.1804351","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44436411","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信