{"title":"衡量学习与发展的有效性:是时候摆脱 Kirkpatrick 和 Phillips 了?","authors":"Cyril Kirwan","doi":"10.1111/ijtd.12342","DOIUrl":null,"url":null,"abstract":"<p>Given the pressure to demonstrate meaningful return from investment in Learning and Development (L&D) interventions, there is an increasing need to reliably evaluate such interventions, both from the point of view of their overall effectiveness (summative approach) and their continuing improvement (formative approach). A literature review, the focus of this conceptual paper, highlights the strengths and weaknesses of various approaches to L&D evaluation. Currently, the most popular methodologies in management practice are the summative-focused frameworks of Donald Kirkpatrick and Jack Phillips. In this paper, their limitations in terms of being able to answer important questions for evaluation are discussed, particularly their failure to take into account a range of factors that influence learning transfer and, thus, learning effectiveness, as well as a lack of guidance on how such interventions could be made better. Arguments for a greater emphasis on formative evaluation are made, and a model for doing so is put forward. Limitations and further research are discussed.</p>","PeriodicalId":46817,"journal":{"name":"International Journal of Training and Development","volume":"29 1","pages":"38-55"},"PeriodicalIF":1.5000,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Measuring the effectiveness of L&D: Time to move on from Kirkpatrick and Phillips?\",\"authors\":\"Cyril Kirwan\",\"doi\":\"10.1111/ijtd.12342\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Given the pressure to demonstrate meaningful return from investment in Learning and Development (L&D) interventions, there is an increasing need to reliably evaluate such interventions, both from the point of view of their overall effectiveness (summative approach) and their continuing improvement (formative approach). A literature review, the focus of this conceptual paper, highlights the strengths and weaknesses of various approaches to L&D evaluation. Currently, the most popular methodologies in management practice are the summative-focused frameworks of Donald Kirkpatrick and Jack Phillips. In this paper, their limitations in terms of being able to answer important questions for evaluation are discussed, particularly their failure to take into account a range of factors that influence learning transfer and, thus, learning effectiveness, as well as a lack of guidance on how such interventions could be made better. Arguments for a greater emphasis on formative evaluation are made, and a model for doing so is put forward. Limitations and further research are discussed.</p>\",\"PeriodicalId\":46817,\"journal\":{\"name\":\"International Journal of Training and Development\",\"volume\":\"29 1\",\"pages\":\"38-55\"},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2024-08-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Training and Development\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/ijtd.12342\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"MANAGEMENT\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Training and Development","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/ijtd.12342","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MANAGEMENT","Score":null,"Total":0}
Measuring the effectiveness of L&D: Time to move on from Kirkpatrick and Phillips?
Given the pressure to demonstrate meaningful return from investment in Learning and Development (L&D) interventions, there is an increasing need to reliably evaluate such interventions, both from the point of view of their overall effectiveness (summative approach) and their continuing improvement (formative approach). A literature review, the focus of this conceptual paper, highlights the strengths and weaknesses of various approaches to L&D evaluation. Currently, the most popular methodologies in management practice are the summative-focused frameworks of Donald Kirkpatrick and Jack Phillips. In this paper, their limitations in terms of being able to answer important questions for evaluation are discussed, particularly their failure to take into account a range of factors that influence learning transfer and, thus, learning effectiveness, as well as a lack of guidance on how such interventions could be made better. Arguments for a greater emphasis on formative evaluation are made, and a model for doing so is put forward. Limitations and further research are discussed.
期刊介绍:
Increasing international competition has led governments and corporations to focus on ways of improving national and corporate economic performance. The effective use of human resources is seen as a prerequisite, and the training and development of employees as paramount. The growth of training and development as an academic subject reflects its growth in practice. The International Journal of Training and Development is an international forum for the reporting of high-quality, original, empirical research. Multidisciplinary, international and comparative, the journal publishes research which ranges from the theoretical, conceptual and methodological to more policy-oriented types of work. The scope of the Journal is training and development, broadly defined. This includes: The determinants of training specifying and testing the explanatory variables which may be related to training identifying and analysing specific factors which give rise to a need for training and development as well as the processes by which those needs become defined, for example, training needs analysis the need for performance improvement the training and development implications of various performance improvement techniques, such as appraisal and assessment the analysis of competence Training and development practice the design, development and delivery of training the learning and development process itself competency-based approaches evaluation: the relationship between training and individual, corporate and macroeconomic performance Policy and strategy organisational aspects of training and development public policy issues questions of infrastructure issues relating to the training and development profession The Journal’s scope encompasses both corporate and public policy analysis. International and comparative work is particularly welcome, as is research which embraces emerging issues and developments.