Assessing clinical micro-skills in deliberate practice exercises: validation of the clinical micro-skill training (CMST) scale.

Objective: To develop and validate a video rating instrument designed to assess transtheoretical clinical micro-skills within deliberate practice (DP) exercises.

Method: The Clinical Micro-Skill Training (CMST) Scale was developed based on three established therapeutic competence measures and refined by expert clinician input. The instrument was then applied by trainee psychotherapists to rate N = 433 videos from N = 59 training candidates, who responded to simulated patient statements as if they were the therapist in that situation. Descriptive results, internal consistency, inter-rater reliability, item structure, convergent and discriminant validity were examined.

Results: The CMST demonstrated good reliability, with an internal consistency of ω = .82 and inter-rater reliability of ICC = .73 for the total score. Exploratory factor analysis revealed three factors-Interpersonal Competence, Communication Competence, and Process and Time Management. The CMST also exhibited satisfactory convergent and discriminant validity.

Conclusion: The CMST demonstrates feasibility, reliability, validity, and efficiency in the assessment of therapeutic micro-skills. Its multidimensional structure allows for a nuanced approach, moving beyond mean scores to evaluate and target specific competence facets for improvement. However, its predictive validity for treatment outcomes remains to be explored in future studies.