Psychometrics and naturalization of nontechnical skills assessment tools in anesthesiology technologist bachelor students in Iran.

IF 1.4 Q3 EDUCATION, SCIENTIFIC DISCIPLINES
Journal of Education and Health Promotion Pub Date : 2025-05-30 eCollection Date: 2025-01-01 DOI:10.4103/jehp.jehp_1957_23
Fateme Aghebati, Shahnam Sedigh Maroufi, Parisa Moradimajd, Azam Saei, Jamileh Abolghasemi Talkhooncheh
{"title":"Psychometrics and naturalization of nontechnical skills assessment tools in anesthesiology technologist bachelor students in Iran.","authors":"Fateme Aghebati, Shahnam Sedigh Maroufi, Parisa Moradimajd, Azam Saei, Jamileh Abolghasemi Talkhooncheh","doi":"10.4103/jehp.jehp_1957_23","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Patient safety has become a major area of concern as studies have reported the role of human error in adverse events. To reduce errors and adverse events, human factors target individual or team nontechnical skills (NTS), which can improve patient safety. Several different assessment tools established for observing and rating NTS as the scope of nurse anesthesia work vary in different countries. Assessing NTS specifically for anesthesia technologists was not considered in Iran. The aim of this study was to find a naturalization and psychometrics nontechnical skills assessment tool for Bachelor of Science in Anesthesia students.</p><p><strong>Materials and method: </strong>This study was conducted with a descriptive method. Investigation databases resulted in selecting an appropriate NTS assessment tool based on anesthesia technologists' domain of work in Iran. Permission to use the tool was obtained from the first author of the article published the tool. Forward-backward translation was applied, and the Persian version was psychometrically evaluated using a questionnaire by an expert panel of 20 anesthesiologists. To determine reliability, videos were recorded in a practice room to show different NTS. Twenty-two anesthesia mentors were selected via available sampling. Simulation videos were provided to the raters with an Internet link to rate the videos. Ratings were repeated after a 10-day interval. Data were gathered and analyzed using intraclass correlation and Cronbach's alpha by SPSS v27.</p><p><strong>Result: </strong>The impact score, explicitness, and transparency were measured to determine face validity. The impact score of items varied in the range of 4.3-5. Minimum explicitness and transparency were related to \"making use of resources\" and \"identifying options\", respectively. Content validity was measured by content validity index and content validity ratio. The content validity ratio of items was in the range of 0.7-1; therefore, no items were removed from the tool. All items reached a content validity index score greater than 0.7. The minimum value for content validity index was for \"making use of resources\" and \"Assessing roles and competencies\". Cronbach's α value varies from 0.285 for task management to 0.959 for team work in different videos. The intraclass correlation of all videos surprisingly was more than 0.75 and significantly high (P-value < 0.05).</p><p><strong>Conclusion: </strong>This study aimed to assess naturalization and psychometrics to assess NTS in anesthesiology technologist bachelor students parallel to international societies. The results of this study were compatible with similar studies. All NTS assessment tool developers emphasize training raters to familiarize with the topic and application of tools, which was done by virtual instruction in this study. Very good reliability values may be affected by this major difference. Future studies are suggested to calculate accuracy and usability in the real clinical environment.</p>","PeriodicalId":15581,"journal":{"name":"Journal of Education and Health Promotion","volume":"14 ","pages":"193"},"PeriodicalIF":1.4000,"publicationDate":"2025-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12200006/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Education and Health Promotion","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4103/jehp.jehp_1957_23","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q3","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Patient safety has become a major area of concern as studies have reported the role of human error in adverse events. To reduce errors and adverse events, human factors target individual or team nontechnical skills (NTS), which can improve patient safety. Several different assessment tools established for observing and rating NTS as the scope of nurse anesthesia work vary in different countries. Assessing NTS specifically for anesthesia technologists was not considered in Iran. The aim of this study was to find a naturalization and psychometrics nontechnical skills assessment tool for Bachelor of Science in Anesthesia students.

Materials and method: This study was conducted with a descriptive method. Investigation databases resulted in selecting an appropriate NTS assessment tool based on anesthesia technologists' domain of work in Iran. Permission to use the tool was obtained from the first author of the article published the tool. Forward-backward translation was applied, and the Persian version was psychometrically evaluated using a questionnaire by an expert panel of 20 anesthesiologists. To determine reliability, videos were recorded in a practice room to show different NTS. Twenty-two anesthesia mentors were selected via available sampling. Simulation videos were provided to the raters with an Internet link to rate the videos. Ratings were repeated after a 10-day interval. Data were gathered and analyzed using intraclass correlation and Cronbach's alpha by SPSS v27.

Result: The impact score, explicitness, and transparency were measured to determine face validity. The impact score of items varied in the range of 4.3-5. Minimum explicitness and transparency were related to "making use of resources" and "identifying options", respectively. Content validity was measured by content validity index and content validity ratio. The content validity ratio of items was in the range of 0.7-1; therefore, no items were removed from the tool. All items reached a content validity index score greater than 0.7. The minimum value for content validity index was for "making use of resources" and "Assessing roles and competencies". Cronbach's α value varies from 0.285 for task management to 0.959 for team work in different videos. The intraclass correlation of all videos surprisingly was more than 0.75 and significantly high (P-value < 0.05).

Conclusion: This study aimed to assess naturalization and psychometrics to assess NTS in anesthesiology technologist bachelor students parallel to international societies. The results of this study were compatible with similar studies. All NTS assessment tool developers emphasize training raters to familiarize with the topic and application of tools, which was done by virtual instruction in this study. Very good reliability values may be affected by this major difference. Future studies are suggested to calculate accuracy and usability in the real clinical environment.

伊朗麻醉学技术学士学生的心理测量学和非技术技能评估工具归化。
背景:由于研究报告了人为失误在不良事件中的作用,患者安全已成为人们关注的主要领域。为了减少错误和不良事件,人为因素针对个人或团队的非技术技能(NTS),这可以提高患者的安全性。在不同的国家,为观察和评价NTS作为护士麻醉工作范围而建立的几种不同的评估工具各不相同。在伊朗,没有考虑专门为麻醉技术人员评估NTS。本研究的目的是为麻醉理学学士学生寻找一个归化和心理测量学非技术技能评估工具。材料与方法:本研究采用描述性方法。调查数据库的结果是根据伊朗麻醉技术人员的工作领域选择适当的NTS评估工具。使用该工具的许可已从发布该工具的文章的第一作者处获得。采用前后翻译,并由20名麻醉师组成的专家小组通过问卷调查对波斯语版本进行心理测量学评估。为了确定可靠性,在练习室录制了不同的NTS视频。通过抽样,选择22名麻醉导师。模拟视频被提供给有互联网连接的评分员,让他们对视频进行评分。每隔10天重复一次评分。数据采集采用SPSS v27进行类内相关和Cronbach’s alpha分析。结果:以影响评分、明确度和透明度来确定面部效度。项目的影响得分在4.3-5之间变化。最低限度的明确性和透明度分别与“利用资源”和“确定备选办法”有关。采用内容效度指数和内容效度比测量内容效度。项目的内容效度比在0.7 ~ 1之间;因此,没有项目被从工具中移除。所有项目的内容效度指数得分均大于0.7。“利用资源”和“评估角色和能力”的内容效度指数最小值。Cronbach’s α值从任务管理的0.285到团队工作在不同视频中的0.959不等。所有视频的类内相关性均大于0.75,且显著高(p值< 0.05)。结论:本研究旨在评估麻醉技术本科学生的归化和心理测量学,以评估NTS与国际接轨。这项研究的结果与类似的研究是一致的。所有NTS评估工具的开发人员都强调训练评分员熟悉主题和工具的应用,本研究采用虚拟教学的方式来完成。非常好的可靠性值可能会受到这个主要差异的影响。未来的研究建议在真实的临床环境中计算准确性和可用性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
2.60
自引率
21.40%
发文量
218
审稿时长
34 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信