Validation of the Objective Structured assessment of Technical Skill (OSATS) in China

IF 2.6 3区医学 Q1 EDUCATION, SCIENTIFIC DISCIPLINES

Journal of Surgical Education Pub Date : 2024-11-09 DOI:10.1016/j.jsurg.2024.103304

Thibault Tricard MD, PhD , JiaHua Pan MD, PhD , QiXiang Song MD , YiHong Lu MD , GuangYao Ye MD, PhD , ZhengQian Bian MD, PhD

{"title":"Validation of the Objective Structured assessment of Technical Skill (OSATS) in China","authors":"Thibault Tricard MD, PhD , JiaHua Pan MD, PhD , QiXiang Song MD , YiHong Lu MD , GuangYao Ye MD, PhD , ZhengQian Bian MD, PhD","doi":"10.1016/j.jsurg.2024.103304","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><div>The aim of this study was to perform a cross-cultural adaptation of the Objective Structured assessment of Technical Skill (OSATS) tool into Chinese and to determine its reproducibility and validity in China.</div></div><div><h3>Methods</h3><div>A Chinese version of OSATS was created through a process of translation, back-translation, expert panel evaluation, pilot testing and then its validation. 59 candidates were included in the study in an international Chinese simulation center including medical students (5th year of medical studies), surgical fellow, attending surgeons, attending professors and professors of surgery. Two exercises performed on synthetic protheses (latex balloons) were designed and filmed: separate suture (3 points) and a circular anastomosis. Each candidate technical competencies were established according to the score by 3 experts. The results of the different scores were correlated against the theoretical background (TB) of the candidates (1 to 5), for each exercise.</div></div><div><h3>Results</h3><div>A Chinese version of OSATS was produced and validated through a back-translation process. The average professors’ residents’ and students’ scores were 35 (± 0.2), 28 (± 0.4) and 18 (± 0.3) respectively. For the objective score cnOSATS on simple sutures, the mean increases from one TB level to the next was 1.63 (0.90-2.37), p < 0.001. For the objective score cnOSATS on running sutures, the mean increases from one TB level to the next was 1.99 (1.22 – 2.77), p < 0.001.</div></div><div><h3>Conclusion</h3><div><u>:</u> This study suggests that the Chinese version of OSATS can reliably and validly assess surgical skills in China.</div></div>","PeriodicalId":50033,"journal":{"name":"Journal of Surgical Education","volume":"82 1","pages":"Article 103304"},"PeriodicalIF":2.6000,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Surgical Education","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1931720424004525","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}

引用次数: 0

Abstract

Introduction

The aim of this study was to perform a cross-cultural adaptation of the Objective Structured assessment of Technical Skill (OSATS) tool into Chinese and to determine its reproducibility and validity in China.

Methods

A Chinese version of OSATS was created through a process of translation, back-translation, expert panel evaluation, pilot testing and then its validation. 59 candidates were included in the study in an international Chinese simulation center including medical students (5th year of medical studies), surgical fellow, attending surgeons, attending professors and professors of surgery. Two exercises performed on synthetic protheses (latex balloons) were designed and filmed: separate suture (3 points) and a circular anastomosis. Each candidate technical competencies were established according to the score by 3 experts. The results of the different scores were correlated against the theoretical background (TB) of the candidates (1 to 5), for each exercise.

Results

A Chinese version of OSATS was produced and validated through a back-translation process. The average professors’ residents’ and students’ scores were 35 (± 0.2), 28 (± 0.4) and 18 (± 0.3) respectively. For the objective score cnOSATS on simple sutures, the mean increases from one TB level to the next was 1.63 (0.90-2.37), p < 0.001. For the objective score cnOSATS on running sutures, the mean increases from one TB level to the next was 1.99 (1.22 – 2.77), p < 0.001.

Conclusion

: This study suggests that the Chinese version of OSATS can reliably and validly assess surgical skills in China.

查看原文本刊更多论文

技术技能客观结构化评估（OSATS）在中国的验证。

简介：本研究旨在将技术技能客观结构化评估工具（OSATS）进行跨文化改编，并确定其在中国的再现性和有效性：本研究旨在将 "技术技能客观结构化评估"（OSATS）工具进行跨文化改编，并确定其在中国的再现性和有效性：方法：通过翻译、回译、专家小组评估、试点测试和验证等过程，创建了中文版的OSATS。在中国的一家国际模拟中心，59 名候选人参加了研究，其中包括医学生（医学专业五年级）、外科研究员、主治外科医生、主治教授和外科教授。研究人员设计并拍摄了两个在合成假体（乳胶气球）上进行的练习：分离缝合（3 点）和环形吻合。根据 3 位专家的评分，确定每位候选人的技术能力。每项练习的不同评分结果都与考生的理论背景（TB）（1 至 5）相关联：结果：OSATS 制作了中文版，并通过回译过程进行了验证。教授、住院医师和学生的平均得分分别为 35 分（± 0.2）、28 分（± 0.4）和 18 分（± 0.3）。就简单缝合的客观评分 cnOSATS 而言，从一个 TB 级别到下一个 TB 级别的平均增幅为 1.63 (0.90-2.37)，P < 0.001。就跑线缝合的客观评分 cnOSATS 而言，从一个结核病级别到下一个结核病级别的平均增幅为 1.99（1.22 - 2.77），P < 0.001：本研究表明，中文版 OSATS 可以可靠、有效地评估中国的外科手术技能。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Surgical Education EDUCATION, SCIENTIFIC DISCIPLINES-SURGERY

CiteScore

5.60

自引率

10.30%

发文量

261

审稿时长

48 days

期刊介绍： The Journal of Surgical Education (JSE) is dedicated to advancing the field of surgical education through original research. The journal publishes research articles in all surgical disciplines on topics relative to the education of surgical students, residents, and fellows, as well as practicing surgeons. Our readers look to JSE for timely, innovative research findings from the international surgical education community. As the official journal of the Association of Program Directors in Surgery (APDS), JSE publishes the proceedings of the annual APDS meeting held during Surgery Education Week.