Best Practices for Test Construction based on Test of English for Aviation Personnel (TEAP)

Abstract

The paper presents best practices necessary for constructing mandatory tests for aviation/aeronautical purposes. Based on the TEAP test, we will show an example of the test form and content in accordance with the ICAO recommendations. We will analyse all the components and talk about their functions. The TEAP test has been used in Ukraine since November 2007. The Test specifications were piloted on 1114 Ukrainian ATCOs during the years of 2007–2009. The TEAP has been authorised by Ukrainian Civil Aviation Authority as a test to be used in Ukraine for licensure purposes of both controllers and pilots. In this paper, the language construct is considered as a benchmark for all aspects of ICAO language proficiency requirements implementation through aviation personnel teaching and testing. According to the Dictionary of Language Testing (1999), a ‘construct’ is defined as an ability or sets of abilities that will be reflected in test performance, and about which inferences can be made on the basis of test scores. The Test practices will be presented on a large-scale format including examiners and raters’ functions which should be viewed as crucial factors to provide the best test qualities – validity, reliability and practicality. Therefore, the TEAP specifications will be presented with the reference to the ICAO Chapter 6 provisions and the roles of examiners/raters as part of the testing system.