Validation and the further disclosures of language test design

Abstract

The subjective validation of language tests and their objective validity remain contested. The debate is clouded by a lack of conceptual clarity: every measure of the adequacy of a test is either subsumed under validity, or other test features are promoted to prime consideration. An alternative is to recognize the technical dimension of experience as the leading function of applied linguistic artefacts such as language tests. In its coherence with other dimensions of reality, the technical aspect generates echoes of those others. These references to other facets are the basis of technically stamped, applied linguistic concepts. While a previous analysis referred to a number of foundational concepts in test design, this paper examines the traces of the lingual, social, economic and ethical aspects within the technical. These are all regulative technical ideas, acting as lodestars in the design of language tests. They are disclosures of the technical meaning of test design. Moreover, they allow applied linguistics to conceive of them as design principles, which must be given concrete shape and form in the actual development of language tests. Acknowledging this state of affairs enables the applied linguist to develop a robust and non-reductionist theory of applied linguistics. Opsomming Daar is geen eenstemmigheid oor wat die subjektiewe validering van taaltoetse asook hul objektiewe geldigheid behels nie. Die debat word vertroebel deur 'n gebrek aan konseptuele duidelikheid: elke maatstaf vir die effektiwiteit van 'n toets word óf ingetrek onder geldigheid, óf verhef tot belangrikste oorweging. Die alternatief is om die tegniese dimensie van ons ervaring as die leidende funksie van toegepaste taalkundige artefakte te erken. In sy samehang met ander dimensies genereer die tegniese aspek analogieë van die ander. Daardie verwysings na ander aspekte vorm die basis van tegnies gekwalifiseerde toegepaste taalkundige begrippe. Waar 'n vorige analise na 'n aantal funderende begrippe verwys het, ondersoek hierdie bydrae die linguale, sosiale, ekonomiese en etiese spore in die tegniese aspek. Hierdie analogieë is almal regulatiewe tegniese idees, wat optree as rigtingwysers in die ontwerp van taaltoetse. Hulle is ook ontsluitings van die tegniese betekenis van toetsontwerp. Terselfdertyd maak hulle dit vir die toegepaste taalkunde moontlik om hulle as ontwerpbeginsels te beskou wat in die ontwikkeling van taaltoetse konkrete beslag en vorm te kry. Om hierdie stand van sake ernstig op te neem is vir die toepgepaste taalkundige die beginpunt van die ontwikkeling van 'n robuuste en nie-reduksionistiese teorie van die toegepaste taalkunde.