Validity Argument for Professional Language Assessment: Evaluating ‘PPSC Test for Recruitment to the Post of Lecturer English’

Abstract

The current research aims to evaluate the validity of the Recruitment Test for Lecturer English (TRLE) conducted by the Punjab Public Service Commission (PPSC). The test scores are used to allocate subject experts to teach English language at degree colleges in Punjab. The researcher follows a mixed-method approach focusing on quantitative data analysis of the five PPSC-TRLEs held between 2013 and 2022. The theories of language test validity informed the validity argument and guided the researcher to devise a tailored analytical framework. The quantitative data analysis and comparison of five tests reveal that it under-represents certain areas of language and exhibits inter-test and intra-test inconsistency. The inclusion of inappropriate and insufficient content leads to invalid test development and unfair decisions. The findings suggest that the test is not flawed for assessing candidates’ language proficiency and predicting their language ability. The study recommends further research to investigate the reliability of the same test and recruitment tests for other subjects.