墨西哥国立自治大学入学考试:高影响和大规模测试的有效性证据

Melchor Sánchez Mendiola, Manuel García Minjares, Adrián Martínez González, Enrique Buzo Casanova
{"title":"墨西哥国立自治大学入学考试:高影响和大规模测试的有效性证据","authors":"Melchor Sánchez Mendiola, Manuel García Minjares, Adrián Martínez González, Enrique Buzo Casanova","doi":"10.15366/RIEE2020.13.2.006","DOIUrl":null,"url":null,"abstract":"Introduction. Higher education institutions’ admission exams are summative high-stakes tests that have important consequences for applicants, so they require validity evidence to assure that appropriate inferences are made with the results. The National Autonomous University of Mexico (UNAM) is the most sought-after higher education institution in the country, annually less than 10% of applicants that take the test are admitted. Methods. Analysis of the sources of the test validity evidence was performed using Messick and Kane conceptual frameworks, as well as the AERA-APA-NCME Standards, with the information generated from the February 2019 admission test in 148.407 applicants. Results: Test validity evidence was identified from content, response process, internal structure, relationship with other variables and consequences. Results suggest that the test has enough validity evidence, to state that the instrument is robust as a technical tool for knowledge assessment and as a source of information for high-stakes decisions. Discussion. It is crucial that institutions that use these tools document their validity evidence, since they have great social relevance. It is necessary to perform periodic longitudinal studies about the test use and its implications, since social and educational conditions in the context of the applicant population are dynamic.","PeriodicalId":166932,"journal":{"name":"Revista Iberoamericana de Evaluación Educativa","volume":"130 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"El Examen de Ingreso a la Universidad Nacional Autónoma de México: Evidencias de Validez de una Prueba de Alto Impacto y Gran Escala\",\"authors\":\"Melchor Sánchez Mendiola, Manuel García Minjares, Adrián Martínez González, Enrique Buzo Casanova\",\"doi\":\"10.15366/RIEE2020.13.2.006\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Introduction. Higher education institutions’ admission exams are summative high-stakes tests that have important consequences for applicants, so they require validity evidence to assure that appropriate inferences are made with the results. The National Autonomous University of Mexico (UNAM) is the most sought-after higher education institution in the country, annually less than 10% of applicants that take the test are admitted. Methods. Analysis of the sources of the test validity evidence was performed using Messick and Kane conceptual frameworks, as well as the AERA-APA-NCME Standards, with the information generated from the February 2019 admission test in 148.407 applicants. Results: Test validity evidence was identified from content, response process, internal structure, relationship with other variables and consequences. Results suggest that the test has enough validity evidence, to state that the instrument is robust as a technical tool for knowledge assessment and as a source of information for high-stakes decisions. Discussion. It is crucial that institutions that use these tools document their validity evidence, since they have great social relevance. It is necessary to perform periodic longitudinal studies about the test use and its implications, since social and educational conditions in the context of the applicant population are dynamic.\",\"PeriodicalId\":166932,\"journal\":{\"name\":\"Revista Iberoamericana de Evaluación Educativa\",\"volume\":\"130 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-09-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Revista Iberoamericana de Evaluación Educativa\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.15366/RIEE2020.13.2.006\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Revista Iberoamericana de Evaluación Educativa","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.15366/RIEE2020.13.2.006","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

介绍。高等教育机构的入学考试是总结性的高风险考试,对申请人有重要的影响,所以他们需要有效的证据来确保对结果做出适当的推断。墨西哥国立自治大学(UNAM)是该国最受欢迎的高等教育机构,每年只有不到10%的申请人参加考试被录取。方法。使用Messick和Kane概念框架以及AERA-APA-NCME标准对测试效度证据的来源进行了分析,并使用了2019年2月148.407名申请人入学测试产生的信息。结果:从内容、反应过程、内部结构、与其他变量的关系、结果等方面确定了检验效度证据。结果表明,该测试有足够的有效性证据,表明该工具作为知识评估的技术工具和作为高风险决策的信息来源是稳健的。讨论。至关重要的是,使用这些工具的机构必须记录其有效性证据,因为它们具有很大的社会相关性。有必要对测试的使用及其影响进行定期的纵向研究,因为申请人群体背景下的社会和教育条件是动态的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
El Examen de Ingreso a la Universidad Nacional Autónoma de México: Evidencias de Validez de una Prueba de Alto Impacto y Gran Escala
Introduction. Higher education institutions’ admission exams are summative high-stakes tests that have important consequences for applicants, so they require validity evidence to assure that appropriate inferences are made with the results. The National Autonomous University of Mexico (UNAM) is the most sought-after higher education institution in the country, annually less than 10% of applicants that take the test are admitted. Methods. Analysis of the sources of the test validity evidence was performed using Messick and Kane conceptual frameworks, as well as the AERA-APA-NCME Standards, with the information generated from the February 2019 admission test in 148.407 applicants. Results: Test validity evidence was identified from content, response process, internal structure, relationship with other variables and consequences. Results suggest that the test has enough validity evidence, to state that the instrument is robust as a technical tool for knowledge assessment and as a source of information for high-stakes decisions. Discussion. It is crucial that institutions that use these tools document their validity evidence, since they have great social relevance. It is necessary to perform periodic longitudinal studies about the test use and its implications, since social and educational conditions in the context of the applicant population are dynamic.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信