Development and Validity Evaluation of a National Digital Entrance Examination Test for Higher Education Student Selection

IF 2.8 Q1 EDUCATION & EDUCATIONAL RESEARCH

HIGHER EDUCATION QUARTERLY Pub Date : 2025-01-18 DOI:10.1111/hequ.70006

K. Talman, J. Vierula, T. Karihtala, E. Laakkonen, J. Engblom, E. Haavisto

{"title":"Development and Validity Evaluation of a National Digital Entrance Examination Test for Higher Education Student Selection","authors":"K. Talman, J. Vierula, T. Karihtala, E. Laakkonen, J. Engblom, E. Haavisto","doi":"10.1111/hequ.70006","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>Higher education institutions need to develop valid, fair, and objective selection methods. Current literature reporting the development and validation of new national large-scale selection tests is scarce. This two-phased study aimed to (1) develop and (2) evaluate the validity of the Finnish digital Universities of Applied Sciences Entrance Examination (UAS Exam). In phase 1 (years 2018–2019), the UAS exam sections were constructed using scoping reviews, document analysis, and expert evaluations. Pilot tests were performed for item analysis using Item Response Theory (IRT). In phase 2, validity evaluation was conducted in a cross-sectional design (October–November 2019) using classical test theory and IRT. The applicants' (<i>n</i> = 13,048) exam scores and the difficulty levels of the exam questions varied in all the exam sections. Psychometrics supported the structure and the use of several exam sections. The usability of the digital exam was evaluated as acceptable. Item analysis revealed development needs in the exam sections.</p>\n </div>","PeriodicalId":51607,"journal":{"name":"HIGHER EDUCATION QUARTERLY","volume":"79 1","pages":""},"PeriodicalIF":2.8000,"publicationDate":"2025-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"HIGHER EDUCATION QUARTERLY","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/hequ.70006","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}

引用次数: 0

Abstract

Higher education institutions need to develop valid, fair, and objective selection methods. Current literature reporting the development and validation of new national large-scale selection tests is scarce. This two-phased study aimed to (1) develop and (2) evaluate the validity of the Finnish digital Universities of Applied Sciences Entrance Examination (UAS Exam). In phase 1 (years 2018–2019), the UAS exam sections were constructed using scoping reviews, document analysis, and expert evaluations. Pilot tests were performed for item analysis using Item Response Theory (IRT). In phase 2, validity evaluation was conducted in a cross-sectional design (October–November 2019) using classical test theory and IRT. The applicants' (n = 13,048) exam scores and the difficulty levels of the exam questions varied in all the exam sections. Psychometrics supported the structure and the use of several exam sections. The usability of the digital exam was evaluated as acceptable. Item analysis revealed development needs in the exam sections.

查看原文本刊更多论文

求助全文

约1分钟内获得全文求助全文

来源期刊

HIGHER EDUCATION QUARTERLY EDUCATION & EDUCATIONAL RESEARCH-

CiteScore

4.50

自引率

9.10%

发文量

期刊介绍： Higher Education Quarterly publishes articles concerned with policy, strategic management and ideas in higher education. A substantial part of its contents is concerned with reporting research findings in ways that bring out their relevance to senior managers and policy makers at institutional and national levels, and to academics who are not necessarily specialists in the academic study of higher education. Higher Education Quarterly also publishes papers that are not based on empirical research but give thoughtful academic analyses of significant policy, management or academic issues.