A training effectiveness methodology-the first step of its development

A research project to determine the feasibility of developing a training effectiveness methodology has been initiated by the Nuclear Regulatory Commission (NRC). The targeted disciplines included: needs assessment; testing and job performance measurement; operational and maintenance data analyses; statistics; training evaluation; and program evaluation. The workshop subject matter experts (SMEs) developed a framework on which to base a methodology. This framework draws together current NRC and nuclear industry processes and initiatives in training evaluation and plant performance monitoring. The framework recognizes that utilities operate closed-loop training systems that incorporate methods for self-correction. The framework proposes that by monitoring/sampling indicator data at various points in the utility's closed-loop system, the NRC can determine whether the loop is operating to maintain training program effectiveness. This training system loop includes the training process, the performance of trained workers, and plant performance. Agreement or lack of agreement between indicators is used to either confirm effective training or to detect training problems.<>