Kye-Yeung Park, Hoon-Ki Park, Jwa-Seop Shin, Taejong Kim, Youngjoo Jung, Min Young Seo, Ketsomsouk Bouphavanh, Sourideth Sengchanh, Ketmany Inthachack
{"title":"利用客观结构化临床考试对跨国研究生能力建设项目进行成果评估。","authors":"Kye-Yeung Park, Hoon-Ki Park, Jwa-Seop Shin, Taejong Kim, Youngjoo Jung, Min Young Seo, Ketsomsouk Bouphavanh, Sourideth Sengchanh, Ketmany Inthachack","doi":"10.1177/0193841X231160805","DOIUrl":null,"url":null,"abstract":"<p><p>Previous studies have applied interview-oriented self-reported or peer-centered evaluation methods, rather than an objective and quantitative method, to evaluate outcome of a postgraduate capacity-building program and have mainly focused on the cognitive level. To investigate the feasibility of the objective structured clinical examination (OSCE) in an international setting and report the results of the outcome evaluation for the behavioral aspect. A case-control study. Ninety examinees divided into 2 case-control groups: 17 program-experienced doctors and 17 control doctors in the first group, and 28 mentees of the program-experienced doctors and 28 control doctors in the second group. A six-station OSCE was implemented. The OSCE scores were measured to evaluate (1) the direct educational effect regarding learning in the first group and (2) the indirect educational effects regarding transfer in the second group. Written questionnaire and interview data were collected for qualitative analysis. The quantitative results of the overall or subcomponent OSCE scores indicated no significant differences in the comparisons of the first and second case-control groups. The qualitative data indicated that the program improved participants' medical knowledge, skills, and self-confidence, however, it also revealed limited learning environment provided by the program. This transnational study has demonstrated the process for introducing and successfully completing the testing of an OSCE in Laos. Discrepancy in the goals of the OSCE and the education program limited the usefulness of OSCE as an assessment tool, leading to the lack of significant differences in its results.</p>","PeriodicalId":47533,"journal":{"name":"Evaluation Review","volume":"47 4","pages":"680-700"},"PeriodicalIF":3.0000,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Outcome Evaluation of a Transnational Postgraduate Capacity-Building Program Using the Objective Structured Clinical Examination.\",\"authors\":\"Kye-Yeung Park, Hoon-Ki Park, Jwa-Seop Shin, Taejong Kim, Youngjoo Jung, Min Young Seo, Ketsomsouk Bouphavanh, Sourideth Sengchanh, Ketmany Inthachack\",\"doi\":\"10.1177/0193841X231160805\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Previous studies have applied interview-oriented self-reported or peer-centered evaluation methods, rather than an objective and quantitative method, to evaluate outcome of a postgraduate capacity-building program and have mainly focused on the cognitive level. To investigate the feasibility of the objective structured clinical examination (OSCE) in an international setting and report the results of the outcome evaluation for the behavioral aspect. A case-control study. Ninety examinees divided into 2 case-control groups: 17 program-experienced doctors and 17 control doctors in the first group, and 28 mentees of the program-experienced doctors and 28 control doctors in the second group. A six-station OSCE was implemented. The OSCE scores were measured to evaluate (1) the direct educational effect regarding learning in the first group and (2) the indirect educational effects regarding transfer in the second group. Written questionnaire and interview data were collected for qualitative analysis. The quantitative results of the overall or subcomponent OSCE scores indicated no significant differences in the comparisons of the first and second case-control groups. The qualitative data indicated that the program improved participants' medical knowledge, skills, and self-confidence, however, it also revealed limited learning environment provided by the program. This transnational study has demonstrated the process for introducing and successfully completing the testing of an OSCE in Laos. Discrepancy in the goals of the OSCE and the education program limited the usefulness of OSCE as an assessment tool, leading to the lack of significant differences in its results.</p>\",\"PeriodicalId\":47533,\"journal\":{\"name\":\"Evaluation Review\",\"volume\":\"47 4\",\"pages\":\"680-700\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2023-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Evaluation Review\",\"FirstCategoryId\":\"90\",\"ListUrlMain\":\"https://doi.org/10.1177/0193841X231160805\",\"RegionNum\":4,\"RegionCategory\":\"社会学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/2/24 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"SOCIAL SCIENCES, INTERDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Evaluation Review","FirstCategoryId":"90","ListUrlMain":"https://doi.org/10.1177/0193841X231160805","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/2/24 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"SOCIAL SCIENCES, INTERDISCIPLINARY","Score":null,"Total":0}
Outcome Evaluation of a Transnational Postgraduate Capacity-Building Program Using the Objective Structured Clinical Examination.
Previous studies have applied interview-oriented self-reported or peer-centered evaluation methods, rather than an objective and quantitative method, to evaluate outcome of a postgraduate capacity-building program and have mainly focused on the cognitive level. To investigate the feasibility of the objective structured clinical examination (OSCE) in an international setting and report the results of the outcome evaluation for the behavioral aspect. A case-control study. Ninety examinees divided into 2 case-control groups: 17 program-experienced doctors and 17 control doctors in the first group, and 28 mentees of the program-experienced doctors and 28 control doctors in the second group. A six-station OSCE was implemented. The OSCE scores were measured to evaluate (1) the direct educational effect regarding learning in the first group and (2) the indirect educational effects regarding transfer in the second group. Written questionnaire and interview data were collected for qualitative analysis. The quantitative results of the overall or subcomponent OSCE scores indicated no significant differences in the comparisons of the first and second case-control groups. The qualitative data indicated that the program improved participants' medical knowledge, skills, and self-confidence, however, it also revealed limited learning environment provided by the program. This transnational study has demonstrated the process for introducing and successfully completing the testing of an OSCE in Laos. Discrepancy in the goals of the OSCE and the education program limited the usefulness of OSCE as an assessment tool, leading to the lack of significant differences in its results.
期刊介绍:
Evaluation Review is the forum for researchers, planners, and policy makers engaged in the development, implementation, and utilization of studies aimed at the betterment of the human condition. The Editors invite submission of papers reporting the findings of evaluation studies in such fields as child development, health, education, income security, manpower, mental health, criminal justice, and the physical and social environments. In addition, Evaluation Review will contain articles on methodological developments, discussions of the state of the art, and commentaries on issues related to the application of research results. Special features will include periodic review essays, "research briefs", and "craft reports".