Training effectiveness evaluation: Advancing a Kirkpatrick model based composite framework

Abstract

The present study aims at ideating a quantitative protocol to evaluate effectiveness of training programmes especially meant for farmers, farm women, and rural youth. The specific objective was to develop a robust framework for measuring the effectiveness of rural training programmes organized by the Farmers Training Centres (FTCs) of India. Kirkpatrick’s training evaluation model provides us the foundation to design a four-dimensional composite framework based on range-based indicator normalization, principal component analysis based indicator weight estimation, and rank correlation based framework sensitivity testing. We used cross-sectional primary data generated through household survey and personal interviews with randomly selected one thousand trainees to test and validate our proposed protocol. Applying it on our evaluation target we find that the degree of effectiveness of the training programmes varies; one in every four training programmes may not be effective. Trainees’ reactions on various aspects of the training programmes may have positive and significant influence on learning. Training outcomes may be linked with the trainees’ post-training changes in behaviour. A sensitivity test confirms that the proposed framework is not susceptible to changes in weighting schemes, implying robustness of indicator selection. The findings offer dissection of individual training programmes guiding policy decisions for a training organization. The proposed framework enriches the Kirkpatrick’s training evaluation model by offering standardized indicators for training effectiveness evaluation.