{"title":"Reliability and Validity of OSCE for Assessment of BSW Competency: Lessons Learned","authors":"M. Rawlings, Barbara J. Johnson","doi":"10.18084/1084-7219.24.1.229","DOIUrl":null,"url":null,"abstract":"Objective structured clinical exams (OSCE) provide opportunity for holistic assessment of social work competency. Using OSCE methodology, the reliability and validity of the OSCE for Social Work: Practice Performance Rating Scale is examined for use in assessing BSW foundation-level direct practice competency using five separate cohorts of BSW students under varying conditions. Findings support good internal consistency. Interrater reliability and concurrent validity are partially supported. The use of OSCE with BSW students is promising when well designed and implemented. OSCE offers a measure in a simulated setting that is direct and multidimensional for evaluation of student competency and assessment of program outcomes. Recommendations for implementation based on lessons learned through multiple testing iterations are provided.","PeriodicalId":407620,"journal":{"name":"Journal of Baccalaureate Social Work","volume":"66 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Baccalaureate Social Work","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.18084/1084-7219.24.1.229","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Objective structured clinical exams (OSCE) provide opportunity for holistic assessment of social work competency. Using OSCE methodology, the reliability and validity of the OSCE for Social Work: Practice Performance Rating Scale is examined for use in assessing BSW foundation-level direct practice competency using five separate cohorts of BSW students under varying conditions. Findings support good internal consistency. Interrater reliability and concurrent validity are partially supported. The use of OSCE with BSW students is promising when well designed and implemented. OSCE offers a measure in a simulated setting that is direct and multidimensional for evaluation of student competency and assessment of program outcomes. Recommendations for implementation based on lessons learned through multiple testing iterations are provided.