JJ Ruiz-Manzanera PhD , J Almela-Baeza PhD , A Aliaga MD , G Ádanez PhD , F Alconchel PhD , JM Rodríguez PhD , F Sánchez-Bueno , P Ramírez , B Febrero PhD
{"title":"在三年级医学生的外科实习中,在带有视听内容的形成性、客观、结构化临床考试中,验证检查表并评估腹痛病例的模拟临床技能","authors":"JJ Ruiz-Manzanera PhD , J Almela-Baeza PhD , A Aliaga MD , G Ádanez PhD , F Alconchel PhD , JM Rodríguez PhD , F Sánchez-Bueno , P Ramírez , B Febrero PhD","doi":"10.1016/j.jsurg.2024.08.016","DOIUrl":null,"url":null,"abstract":"<div><h3>OBJECTIVES</h3><p>The objective of this study was to develop and validate 6 checklists for evaluating abdominal pain in clinical simulation scenarios; to assess student competencies in managing 6 clinical cases using OSCE, based on faculty evaluations; and to analyze discrepancies between faculty and student evaluations.</p></div><div><h3>DESIGN</h3><p>A practical workshop was designed to address 6 clinical scenarios of abdominal surgical conditions. Four scenarios employed medium fidelity simulators, while 2 scenarios employed standardized patient methodology. Prior to the workshop, students received theoretical audiovisual material. At the conclusion of the workshop, students were evaluated using checklists that assessed communication, privacy, anamnesis, and technical skills. Ten workshops were conducted over 3 years, using the OSCE (Objective Structured Clinical Examination) format for evaluation.</p></div><div><h3>SETTING</h3><p>In the statistical analysis, t-Student tests or ANOVA were employed to ascertain whether there were any significant differences between the groups. In the process of validating checklists for clinical scenarios, 6 experts were asked to evaluate each item on a scale of 1 to 9. To assess the degree of agreement among experts, the intraclass correlation coefficient (ICC) was employed.</p></div><div><h3>PARTICIPANTS</h3><p>The study involved a total of 670 third-year medical students from the University of Murcia (UMU), Spain, who participated in the subject \"Medical-Surgical Skills.\"</p></div><div><h3>RESULTS</h3><p>High levels of appropriateness were observed for the checklist items, with mean scores above 7.5 points, as well as high levels of inter-expert agreement. Students obtained a mean score of 8 points in the evaluation of each clinical scenario. No significant differences were found between faculty and student scores (p < 0.05).</p></div><div><h3>CONCLUSIONS</h3><p>The learning method focused on clinical scenarios of abdominal surgical diseases effectively enhanced the clinical skills of third-year medical students. It used pre-existing audiovisual materials, hands-on workshops with medium-fidelity simulators, and standardized patients. Consistent evaluations from students and faculty confirmed the efficacy of these strategies.</p></div>","PeriodicalId":50033,"journal":{"name":"Journal of Surgical Education","volume":"81 11","pages":"Pages 1756-1763"},"PeriodicalIF":2.6000,"publicationDate":"2024-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S193172042400391X/pdfft?md5=a0834c6283947dbd2aade95137c7ecae&pid=1-s2.0-S193172042400391X-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Validation of Checklists and Evaluation of Clinical Skills in Cases of Abdominal Pain With Simulation in Formative, Objective, Structured Clinical Examination With Audiovisual Content in Third-Year Medical Students' Surgical Clerkship\",\"authors\":\"JJ Ruiz-Manzanera PhD , J Almela-Baeza PhD , A Aliaga MD , G Ádanez PhD , F Alconchel PhD , JM Rodríguez PhD , F Sánchez-Bueno , P Ramírez , B Febrero PhD\",\"doi\":\"10.1016/j.jsurg.2024.08.016\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>OBJECTIVES</h3><p>The objective of this study was to develop and validate 6 checklists for evaluating abdominal pain in clinical simulation scenarios; to assess student competencies in managing 6 clinical cases using OSCE, based on faculty evaluations; and to analyze discrepancies between faculty and student evaluations.</p></div><div><h3>DESIGN</h3><p>A practical workshop was designed to address 6 clinical scenarios of abdominal surgical conditions. Four scenarios employed medium fidelity simulators, while 2 scenarios employed standardized patient methodology. Prior to the workshop, students received theoretical audiovisual material. At the conclusion of the workshop, students were evaluated using checklists that assessed communication, privacy, anamnesis, and technical skills. Ten workshops were conducted over 3 years, using the OSCE (Objective Structured Clinical Examination) format for evaluation.</p></div><div><h3>SETTING</h3><p>In the statistical analysis, t-Student tests or ANOVA were employed to ascertain whether there were any significant differences between the groups. In the process of validating checklists for clinical scenarios, 6 experts were asked to evaluate each item on a scale of 1 to 9. To assess the degree of agreement among experts, the intraclass correlation coefficient (ICC) was employed.</p></div><div><h3>PARTICIPANTS</h3><p>The study involved a total of 670 third-year medical students from the University of Murcia (UMU), Spain, who participated in the subject \\\"Medical-Surgical Skills.\\\"</p></div><div><h3>RESULTS</h3><p>High levels of appropriateness were observed for the checklist items, with mean scores above 7.5 points, as well as high levels of inter-expert agreement. Students obtained a mean score of 8 points in the evaluation of each clinical scenario. No significant differences were found between faculty and student scores (p < 0.05).</p></div><div><h3>CONCLUSIONS</h3><p>The learning method focused on clinical scenarios of abdominal surgical diseases effectively enhanced the clinical skills of third-year medical students. It used pre-existing audiovisual materials, hands-on workshops with medium-fidelity simulators, and standardized patients. Consistent evaluations from students and faculty confirmed the efficacy of these strategies.</p></div>\",\"PeriodicalId\":50033,\"journal\":{\"name\":\"Journal of Surgical Education\",\"volume\":\"81 11\",\"pages\":\"Pages 1756-1763\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-09-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S193172042400391X/pdfft?md5=a0834c6283947dbd2aade95137c7ecae&pid=1-s2.0-S193172042400391X-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Surgical Education\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S193172042400391X\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION, SCIENTIFIC DISCIPLINES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Surgical Education","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S193172042400391X","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
Validation of Checklists and Evaluation of Clinical Skills in Cases of Abdominal Pain With Simulation in Formative, Objective, Structured Clinical Examination With Audiovisual Content in Third-Year Medical Students' Surgical Clerkship
OBJECTIVES
The objective of this study was to develop and validate 6 checklists for evaluating abdominal pain in clinical simulation scenarios; to assess student competencies in managing 6 clinical cases using OSCE, based on faculty evaluations; and to analyze discrepancies between faculty and student evaluations.
DESIGN
A practical workshop was designed to address 6 clinical scenarios of abdominal surgical conditions. Four scenarios employed medium fidelity simulators, while 2 scenarios employed standardized patient methodology. Prior to the workshop, students received theoretical audiovisual material. At the conclusion of the workshop, students were evaluated using checklists that assessed communication, privacy, anamnesis, and technical skills. Ten workshops were conducted over 3 years, using the OSCE (Objective Structured Clinical Examination) format for evaluation.
SETTING
In the statistical analysis, t-Student tests or ANOVA were employed to ascertain whether there were any significant differences between the groups. In the process of validating checklists for clinical scenarios, 6 experts were asked to evaluate each item on a scale of 1 to 9. To assess the degree of agreement among experts, the intraclass correlation coefficient (ICC) was employed.
PARTICIPANTS
The study involved a total of 670 third-year medical students from the University of Murcia (UMU), Spain, who participated in the subject "Medical-Surgical Skills."
RESULTS
High levels of appropriateness were observed for the checklist items, with mean scores above 7.5 points, as well as high levels of inter-expert agreement. Students obtained a mean score of 8 points in the evaluation of each clinical scenario. No significant differences were found between faculty and student scores (p < 0.05).
CONCLUSIONS
The learning method focused on clinical scenarios of abdominal surgical diseases effectively enhanced the clinical skills of third-year medical students. It used pre-existing audiovisual materials, hands-on workshops with medium-fidelity simulators, and standardized patients. Consistent evaluations from students and faculty confirmed the efficacy of these strategies.
期刊介绍:
The Journal of Surgical Education (JSE) is dedicated to advancing the field of surgical education through original research. The journal publishes research articles in all surgical disciplines on topics relative to the education of surgical students, residents, and fellows, as well as practicing surgeons. Our readers look to JSE for timely, innovative research findings from the international surgical education community. As the official journal of the Association of Program Directors in Surgery (APDS), JSE publishes the proceedings of the annual APDS meeting held during Surgery Education Week.