K. Talman, J. Vierula, T. Karihtala, E. Laakkonen, J. Engblom, E. Haavisto
{"title":"国家高等教育招生数字考试系统的开发与有效性评价","authors":"K. Talman, J. Vierula, T. Karihtala, E. Laakkonen, J. Engblom, E. Haavisto","doi":"10.1111/hequ.70006","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>Higher education institutions need to develop valid, fair, and objective selection methods. Current literature reporting the development and validation of new national large-scale selection tests is scarce. This two-phased study aimed to (1) develop and (2) evaluate the validity of the Finnish digital Universities of Applied Sciences Entrance Examination (UAS Exam). In phase 1 (years 2018–2019), the UAS exam sections were constructed using scoping reviews, document analysis, and expert evaluations. Pilot tests were performed for item analysis using Item Response Theory (IRT). In phase 2, validity evaluation was conducted in a cross-sectional design (October–November 2019) using classical test theory and IRT. The applicants' (<i>n</i> = 13,048) exam scores and the difficulty levels of the exam questions varied in all the exam sections. Psychometrics supported the structure and the use of several exam sections. The usability of the digital exam was evaluated as acceptable. Item analysis revealed development needs in the exam sections.</p>\n </div>","PeriodicalId":51607,"journal":{"name":"HIGHER EDUCATION QUARTERLY","volume":"79 1","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2025-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development and Validity Evaluation of a National Digital Entrance Examination Test for Higher Education Student Selection\",\"authors\":\"K. Talman, J. Vierula, T. Karihtala, E. Laakkonen, J. Engblom, E. Haavisto\",\"doi\":\"10.1111/hequ.70006\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>Higher education institutions need to develop valid, fair, and objective selection methods. Current literature reporting the development and validation of new national large-scale selection tests is scarce. This two-phased study aimed to (1) develop and (2) evaluate the validity of the Finnish digital Universities of Applied Sciences Entrance Examination (UAS Exam). In phase 1 (years 2018–2019), the UAS exam sections were constructed using scoping reviews, document analysis, and expert evaluations. Pilot tests were performed for item analysis using Item Response Theory (IRT). In phase 2, validity evaluation was conducted in a cross-sectional design (October–November 2019) using classical test theory and IRT. The applicants' (<i>n</i> = 13,048) exam scores and the difficulty levels of the exam questions varied in all the exam sections. Psychometrics supported the structure and the use of several exam sections. The usability of the digital exam was evaluated as acceptable. Item analysis revealed development needs in the exam sections.</p>\\n </div>\",\"PeriodicalId\":51607,\"journal\":{\"name\":\"HIGHER EDUCATION QUARTERLY\",\"volume\":\"79 1\",\"pages\":\"\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2025-01-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"HIGHER EDUCATION QUARTERLY\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/hequ.70006\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"HIGHER EDUCATION QUARTERLY","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/hequ.70006","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
Development and Validity Evaluation of a National Digital Entrance Examination Test for Higher Education Student Selection
Higher education institutions need to develop valid, fair, and objective selection methods. Current literature reporting the development and validation of new national large-scale selection tests is scarce. This two-phased study aimed to (1) develop and (2) evaluate the validity of the Finnish digital Universities of Applied Sciences Entrance Examination (UAS Exam). In phase 1 (years 2018–2019), the UAS exam sections were constructed using scoping reviews, document analysis, and expert evaluations. Pilot tests were performed for item analysis using Item Response Theory (IRT). In phase 2, validity evaluation was conducted in a cross-sectional design (October–November 2019) using classical test theory and IRT. The applicants' (n = 13,048) exam scores and the difficulty levels of the exam questions varied in all the exam sections. Psychometrics supported the structure and the use of several exam sections. The usability of the digital exam was evaluated as acceptable. Item analysis revealed development needs in the exam sections.
期刊介绍：
Higher Education Quarterly publishes articles concerned with policy, strategic management and ideas in higher education. A substantial part of its contents is concerned with reporting research findings in ways that bring out their relevance to senior managers and policy makers at institutional and national levels, and to academics who are not necessarily specialists in the academic study of higher education. Higher Education Quarterly also publishes papers that are not based on empirical research but give thoughtful academic analyses of significant policy, management or academic issues.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
