A METHOD and RESOURCES for ASSESSING the Reliability of Simulation Evaluation Instruments

Nursing Education Perspective Pub Date : 2012-09-01 DOI:10.5480/1536-5026-33.5.334

K. Adamson, S. Kardong-Edgren

{"title":"A METHOD and RESOURCES for ASSESSING the Reliability of Simulation Evaluation Instruments","authors":"K. Adamson, S. Kardong-Edgren","doi":"10.5480/1536-5026-33.5.334","DOIUrl":null,"url":null,"abstract":"Aim. This article describes a successfully piloted method for facilitating rapid psychometric assessments of three simulation evaluation instruments: the Lasater Clinical Judgment Rubric, the Seattle University Evaluation Tool, and the Creighton‐Simulation Evaluation Instrument™. Background. To provide valid and reliable evaluations of student performance in simulation activities, it is important to assess the psychometric properties of evaluation instruments. Method. This novel method incorporates the use of a database of validated, video‐archived simulations depicting nursing students performing at varying levels of proficiency. A widely dispersed sample of 29 raters viewed and scored multiple scenarios over a six‐week period. Analyses are described including inter‐ and intrarater reliability, internal consistency, and validity assessments. Results and Conclusion. Descriptive and inferential statistics supported the validity of the leveled scenarios. The inter‐ and intrarater reliability and internal consistencies of data from the three tools are provided. The article provides information and resources for readers to access in order to assess their own simulation evaluation instruments using the described methods.","PeriodicalId":153271,"journal":{"name":"Nursing Education Perspective","volume":"108 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2012-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"64","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nursing Education Perspective","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5480/1536-5026-33.5.334","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 64

Abstract

Aim. This article describes a successfully piloted method for facilitating rapid psychometric assessments of three simulation evaluation instruments: the Lasater Clinical Judgment Rubric, the Seattle University Evaluation Tool, and the Creighton‐Simulation Evaluation Instrument™. Background. To provide valid and reliable evaluations of student performance in simulation activities, it is important to assess the psychometric properties of evaluation instruments. Method. This novel method incorporates the use of a database of validated, video‐archived simulations depicting nursing students performing at varying levels of proficiency. A widely dispersed sample of 29 raters viewed and scored multiple scenarios over a six‐week period. Analyses are described including inter‐ and intrarater reliability, internal consistency, and validity assessments. Results and Conclusion. Descriptive and inferential statistics supported the validity of the leveled scenarios. The inter‐ and intrarater reliability and internal consistencies of data from the three tools are provided. The article provides information and resources for readers to access in order to assess their own simulation evaluation instruments using the described methods.

查看原文本刊更多论文

仿真评估仪器可靠性评估方法与资源

的目标。本文描述了一种成功的试点方法，用于促进三种模拟评估工具的快速心理测量评估:激光临床判断准则，西雅图大学评估工具和克雷顿模拟评估工具™。背景。为了对学生在模拟活动中的表现提供有效和可靠的评估，评估评估工具的心理测量特性是很重要的。方法。这种新颖的方法结合了一个经过验证的数据库，视频存档模拟，描绘了护理学生在不同水平的熟练程度。在六周的时间里，由29名评分者组成的广泛分散的样本观看并评分了多个场景。分析描述包括内部和内部信度，内部一致性和有效性评估。结果与结论。描述性和推断性统计支持了分级情景的有效性。提供了三种工具数据的内部和内部可靠性和内部一致性。本文为读者提供了信息和资源，以便使用所描述的方法评估他们自己的模拟评估工具。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Nursing Education Perspective

自引率

0.00%

发文量