Neville Chiavaroli, Luc Le, Lyndal Parker-Newlyn, Sean Pywell
{"title":"我们是否应该延长认知能力测试分数的有效期?从医学选拔中的构建、公平和心理测量学角度进行思考","authors":"Neville Chiavaroli, Luc Le, Lyndal Parker-Newlyn, Sean Pywell","doi":"10.1111/ijsa.12453","DOIUrl":null,"url":null,"abstract":"<p>Scores on cognitive ability tests used in tertiary admissions contexts generally have very limited currency. This can have significant implications for prospective applicants to high-demand courses which use cognitive tests as part of the selection process. In this paper we present both psychometric and non-psychometric considerations regarding the score currency of ability tests, using GAMSAT (Graduate Medical School Admissions Test) as an example. We found that GAMSAT scores showed sufficient stability at the cohort level for institutions to be reasonably confident that a test score would continue to provide a valid representation of cognitive ability for up to a 5-year period. However, candidates’ pre-test preparation will influence whether it is in their interest to re-sit a test even within an extended currency period.</p>","PeriodicalId":51465,"journal":{"name":"International Journal of Selection and Assessment","volume":"32 1","pages":"138-148"},"PeriodicalIF":2.6000,"publicationDate":"2023-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Should we extend the currency of cognitive ability test scores? Considerations from construct, equity, and psychometric perspectives in medical selection\",\"authors\":\"Neville Chiavaroli, Luc Le, Lyndal Parker-Newlyn, Sean Pywell\",\"doi\":\"10.1111/ijsa.12453\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Scores on cognitive ability tests used in tertiary admissions contexts generally have very limited currency. This can have significant implications for prospective applicants to high-demand courses which use cognitive tests as part of the selection process. In this paper we present both psychometric and non-psychometric considerations regarding the score currency of ability tests, using GAMSAT (Graduate Medical School Admissions Test) as an example. We found that GAMSAT scores showed sufficient stability at the cohort level for institutions to be reasonably confident that a test score would continue to provide a valid representation of cognitive ability for up to a 5-year period. However, candidates’ pre-test preparation will influence whether it is in their interest to re-sit a test even within an extended currency period.</p>\",\"PeriodicalId\":51465,\"journal\":{\"name\":\"International Journal of Selection and Assessment\",\"volume\":\"32 1\",\"pages\":\"138-148\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2023-09-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Selection and Assessment\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/ijsa.12453\",\"RegionNum\":4,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"MANAGEMENT\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Selection and Assessment","FirstCategoryId":"91","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/ijsa.12453","RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MANAGEMENT","Score":null,"Total":0}
Should we extend the currency of cognitive ability test scores? Considerations from construct, equity, and psychometric perspectives in medical selection
Scores on cognitive ability tests used in tertiary admissions contexts generally have very limited currency. This can have significant implications for prospective applicants to high-demand courses which use cognitive tests as part of the selection process. In this paper we present both psychometric and non-psychometric considerations regarding the score currency of ability tests, using GAMSAT (Graduate Medical School Admissions Test) as an example. We found that GAMSAT scores showed sufficient stability at the cohort level for institutions to be reasonably confident that a test score would continue to provide a valid representation of cognitive ability for up to a 5-year period. However, candidates’ pre-test preparation will influence whether it is in their interest to re-sit a test even within an extended currency period.
期刊介绍:
The International Journal of Selection and Assessment publishes original articles related to all aspects of personnel selection, staffing, and assessment in organizations. Using an effective combination of academic research with professional-led best practice, IJSA aims to develop new knowledge and understanding in these important areas of work psychology and contemporary workforce management.