我们是否应该延长认知能力测试分数的有效期?从医学选拔中的构建、公平和心理测量学角度进行思考

IF 2.6 4区 管理学 Q3 MANAGEMENT
Neville Chiavaroli, Luc Le, Lyndal Parker-Newlyn, Sean Pywell
{"title":"我们是否应该延长认知能力测试分数的有效期?从医学选拔中的构建、公平和心理测量学角度进行思考","authors":"Neville Chiavaroli,&nbsp;Luc Le,&nbsp;Lyndal Parker-Newlyn,&nbsp;Sean Pywell","doi":"10.1111/ijsa.12453","DOIUrl":null,"url":null,"abstract":"<p>Scores on cognitive ability tests used in tertiary admissions contexts generally have very limited currency. This can have significant implications for prospective applicants to high-demand courses which use cognitive tests as part of the selection process. In this paper we present both psychometric and non-psychometric considerations regarding the score currency of ability tests, using GAMSAT (Graduate Medical School Admissions Test) as an example. We found that GAMSAT scores showed sufficient stability at the cohort level for institutions to be reasonably confident that a test score would continue to provide a valid representation of cognitive ability for up to a 5-year period. However, candidates’ pre-test preparation will influence whether it is in their interest to re-sit a test even within an extended currency period.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":"32 1","pages":"138-148"},"PeriodicalIF":2.6000,"publicationDate":"2023-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Should we extend the currency of cognitive ability test scores? Considerations from construct, equity, and psychometric perspectives in medical selection\",\"authors\":\"Neville Chiavaroli,&nbsp;Luc Le,&nbsp;Lyndal Parker-Newlyn,&nbsp;Sean Pywell\",\"doi\":\"10.1111/ijsa.12453\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Scores on cognitive ability tests used in tertiary admissions contexts generally have very limited currency. This can have significant implications for prospective applicants to high-demand courses which use cognitive tests as part of the selection process. In this paper we present both psychometric and non-psychometric considerations regarding the score currency of ability tests, using GAMSAT (Graduate Medical School Admissions Test) as an example. We found that GAMSAT scores showed sufficient stability at the cohort level for institutions to be reasonably confident that a test score would continue to provide a valid representation of cognitive ability for up to a 5-year period. However, candidates’ pre-test preparation will influence whether it is in their interest to re-sit a test even within an extended currency period.</p>\",\"PeriodicalId\":51465,\"journal\":{\"name\":\"International Journal of Selection and Assessment\",\"volume\":\"32 1\",\"pages\":\"138-148\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2023-09-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Selection and Assessment\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/ijsa.12453\",\"RegionNum\":4,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"MANAGEMENT\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Selection and Assessment","FirstCategoryId":"91","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/ijsa.12453","RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MANAGEMENT","Score":null,"Total":0}
引用次数: 0

摘要

在高等院校招生中使用的认知能力测验分数通常具有非常有限的时效性。这对于那些将认知测试作为选拔过程一部分的高需求课程的潜在申请人来说,可能会产生重大影响。在本文中,我们以 GAMSAT(医学院研究生入学考试)为例,介绍了有关能力测验分数时效性的心理测量学和非心理测量学考虑因素。我们发现,GAMSAT 分数在组群水平上显示出足够的稳定性,因此院校有理由相信,考试分数将在长达 5 年的时间里继续有效地反映考生的认知能力。然而,考生的考前准备情况会影响到他们是否有兴趣重新参加考试,即使是在较长的有效期内。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Should we extend the currency of cognitive ability test scores? Considerations from construct, equity, and psychometric perspectives in medical selection

Scores on cognitive ability tests used in tertiary admissions contexts generally have very limited currency. This can have significant implications for prospective applicants to high-demand courses which use cognitive tests as part of the selection process. In this paper we present both psychometric and non-psychometric considerations regarding the score currency of ability tests, using GAMSAT (Graduate Medical School Admissions Test) as an example. We found that GAMSAT scores showed sufficient stability at the cohort level for institutions to be reasonably confident that a test score would continue to provide a valid representation of cognitive ability for up to a 5-year period. However, candidates’ pre-test preparation will influence whether it is in their interest to re-sit a test even within an extended currency period.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
4.10
自引率
31.80%
发文量
46
期刊介绍: The International Journal of Selection and Assessment publishes original articles related to all aspects of personnel selection, staffing, and assessment in organizations. Using an effective combination of academic research with professional-led best practice, IJSA aims to develop new knowledge and understanding in these important areas of work psychology and contemporary workforce management.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信