Idea Evaluation: Can Training Facilitate the Recognition of Creative Ideas?

Abstract

Wallas suggests a number of cognitive processes associated with creativity, including the process of verification. Accurately evaluating creative ideas is a complex skill that often requires deep domain expertise or extensive training. This study examined whether better training methods can effectively enhance the accuracy of creativity ratings. Using a 2 (training: with practice and feedback vs. no practice) × 3 (rating rubric quality: low, moderate, high) between-subjects design, novice raters (N = 216) evaluated solutions to an ill-defined problem previously scored by expert judges. Rating accuracy was defined as the correspondence between participant and expert ratings on dimensions of originality and quality. Results indicated that participants who received practice and feedback during training, and those provided with more descriptive rating rubrics, demonstrated significantly greater accuracy in judging solution quality. However, these effects did not extend to originality ratings. Findings suggest that better rater training can improve aspects of creativity assessment, particularly when it includes opportunities for guided practice and detailed evaluation criteria. Implications for creativity assessment and scalable training methods are discussed.