Inter-rater Reliability of Pressure Pain Threshold Between Experienced and Novice Examiners: A Case Study of 2 Educational Approaches.

Abigail T Wilson, Carey E Rothschild
{"title":"Inter-rater Reliability of Pressure Pain Threshold Between Experienced and Novice Examiners: A Case Study of 2 Educational Approaches.","authors":"Abigail T Wilson, Carey E Rothschild","doi":"10.1097/JTE.0000000000000376","DOIUrl":null,"url":null,"abstract":"<p><strong>Background and purpose: </strong>Pressure Pain Threshold (PPT) is used to objectively assess pain in clinical settings and is a recommended part of physical therapist education. An individual who is experienced in administering PPT will frequently train a student on the technique; however, optimal educational approaches for this instruction have not yet been identified. Therefore, the purpose of this case report is to describe 2 educational approaches (unstructured lecture and structured feedback with clinical relevance) in training 2 separate cohorts of Doctor of Physical Therapy students in PPT. The primary outcome of interest was the inter-rater reliability of PPT between an experienced and novice examiner.</p><p><strong>Case description: </strong>Cohort 1 (n = 37) received a traditional lecture approach consisting of watching a prerecorded video online, an in-person lecture with demonstration of the technique, and time to practice. Cohort 2 (n = 34) received the prerecorded video online and lecture with demonstration; however, key additions included a clinical relevance discussion along with structured peer-to-peer and instructor-to-student feedback using a competency-based checklist. PPT was assessed by each student (novice examiner) and one instructor (experienced examiner). Inter-rater reliability of PPT between a novice and experienced examiner was evaluated.</p><p><strong>Outcomes: </strong>Inter-rater reliability improved from poor/moderate (intraclass correlation coefficient low back = 0.46 [0.16-0.68], quadriceps = 0.54 [0.26-0.73]) to good (low back = 0.84 [0.67-0.92], quadriceps = 0.90 [0.79-0.95]) after the addition of structured feedback.</p><p><strong>Discussion: </strong>Structured feedback from peers and instructors may be useful when learning PPT and improving inter-rater reliability, which has implications for training students within a laboratory or classroom. However, this case study would need to be replicated in an experimental design to examine the effects of varying types of feedback on learning outcomes.</p>","PeriodicalId":517432,"journal":{"name":"Journal, physical therapy education","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal, physical therapy education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1097/JTE.0000000000000376","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Background and purpose: Pressure Pain Threshold (PPT) is used to objectively assess pain in clinical settings and is a recommended part of physical therapist education. An individual who is experienced in administering PPT will frequently train a student on the technique; however, optimal educational approaches for this instruction have not yet been identified. Therefore, the purpose of this case report is to describe 2 educational approaches (unstructured lecture and structured feedback with clinical relevance) in training 2 separate cohorts of Doctor of Physical Therapy students in PPT. The primary outcome of interest was the inter-rater reliability of PPT between an experienced and novice examiner.

Case description: Cohort 1 (n = 37) received a traditional lecture approach consisting of watching a prerecorded video online, an in-person lecture with demonstration of the technique, and time to practice. Cohort 2 (n = 34) received the prerecorded video online and lecture with demonstration; however, key additions included a clinical relevance discussion along with structured peer-to-peer and instructor-to-student feedback using a competency-based checklist. PPT was assessed by each student (novice examiner) and one instructor (experienced examiner). Inter-rater reliability of PPT between a novice and experienced examiner was evaluated.

Outcomes: Inter-rater reliability improved from poor/moderate (intraclass correlation coefficient low back = 0.46 [0.16-0.68], quadriceps = 0.54 [0.26-0.73]) to good (low back = 0.84 [0.67-0.92], quadriceps = 0.90 [0.79-0.95]) after the addition of structured feedback.

Discussion: Structured feedback from peers and instructors may be useful when learning PPT and improving inter-rater reliability, which has implications for training students within a laboratory or classroom. However, this case study would need to be replicated in an experimental design to examine the effects of varying types of feedback on learning outcomes.

经验丰富的检查员与新手之间压痛阈值的互评可靠性:两种教育方法的案例研究。
背景和目的:压痛阈值(PPT)用于在临床环境中客观评估疼痛,是理疗师教育中推荐的一部分。在实施 PPT 方面经验丰富的个人经常会对学生进行该技术的培训;然而,目前尚未确定该教学的最佳教育方法。因此,本病例报告旨在描述在对两批不同的理疗学博士生进行 PPT 培训时所采用的两种教育方法(非结构化讲座和与临床相关的结构化反馈)。主要结果是有经验的考官和新手之间的 PPT 评判可靠性:第一组学生(37 人)采用传统的授课方式,包括在线观看预先录制的视频、现场授课和技术演示以及练习时间。第二组学生(34 人)接受在线预录视频和演示讲座,但主要增加了临床相关性讨论,以及使用基于能力的核对表进行结构化的同行和教师对学生反馈。PPT 由每名学生(新手考官)和一名教师(经验丰富的考官)进行评估。对新手和经验丰富的考官之间 PPT 的评分者间可靠性进行了评估:结果:在加入结构化反馈后,评分者之间的可靠性从较差/中等(类内相关系数腰背=0.46 [0.16-0.68],股四头肌=0.54 [0.26-0.73])提高到良好(腰背=0.84 [0.67-0.92],股四头肌=0.90 [0.79-0.95]):讨论:在学习 PPT 和提高评分者之间的可靠性时,来自同伴和指导者的结构化反馈可能很有用,这对在实验室或教室内培训学生有一定的意义。不过,这项案例研究需要在实验设计中加以复制,以检验不同类型的反馈对学习效果的影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信