根据对受训人员表现的观察报告做出判断:卫生职业教育的范围界定审查。

Canadian medical education journal Pub Date : 2024-08-30 eCollection Date: 2024-08-01 DOI:10.36834/cmej.75522
Patricia Blanchette, Marie-Eve Poitras, Audrey-Ann Lefebvre, Christina St-Onge
{"title":"根据对受训人员表现的观察报告做出判断:卫生职业教育的范围界定审查。","authors":"Patricia Blanchette, Marie-Eve Poitras, Audrey-Ann Lefebvre, Christina St-Onge","doi":"10.36834/cmej.75522","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Educators now use reported observations when assessing trainees' performance. Unfortunately, they have little information about how to design and implement assessments based on reported observations.</p><p><strong>Objective: </strong>The purpose of this scoping review was to map the literature on the use of reported observations in judging health professions education (HPE) trainees' performances.</p><p><strong>Methods: </strong>Arksey and O'Malley's (2005) method was used with four databases (sources: ERIC, CINAHL, MEDLINE, PsycINFO). Eligibility criteria for articles were: documents in English or French, including primary data, and initial or professional training; (2) training in an HPE program; (3) workplace-based assessment; and (4) assessment based on reported observations. The inclusion/exclusion, and data extraction steps were performed (agreement rate > 90%). We developed a data extraction grid to chart the data. Descriptive analyses were used to summarize quantitative data, and the authors conducted thematic analysis for qualitative data.</p><p><strong>Results: </strong>Based on 36 papers and 13 consultations, the team identified six steps characterizing trainee performance assessment based on reported observations in HPE: (1) making first contact, (2) observing and documenting the trainee performance, (3) collecting and completing assessment data, (4) aggregating assessment data, (5) inferring the level of competence, and (6) documenting and communicating the decision to the stakeholders.</p><p><strong>Discussion: </strong>The design and implementation of assessment based on reported observations is a first step towards a quality implementation by guiding educators and administrators responsible for graduating competent professionals. Future research might focus on understanding the context beyond assessor cognition to ensure the quality of meta-assessors' decisions.</p>","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":"15 4","pages":"63-75"},"PeriodicalIF":0.0000,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11415737/pdf/","citationCount":"0","resultStr":"{\"title\":\"Making judgments based on reported observations of trainee performance: a scoping review in Health Professions Education.\",\"authors\":\"Patricia Blanchette, Marie-Eve Poitras, Audrey-Ann Lefebvre, Christina St-Onge\",\"doi\":\"10.36834/cmej.75522\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Educators now use reported observations when assessing trainees' performance. Unfortunately, they have little information about how to design and implement assessments based on reported observations.</p><p><strong>Objective: </strong>The purpose of this scoping review was to map the literature on the use of reported observations in judging health professions education (HPE) trainees' performances.</p><p><strong>Methods: </strong>Arksey and O'Malley's (2005) method was used with four databases (sources: ERIC, CINAHL, MEDLINE, PsycINFO). Eligibility criteria for articles were: documents in English or French, including primary data, and initial or professional training; (2) training in an HPE program; (3) workplace-based assessment; and (4) assessment based on reported observations. The inclusion/exclusion, and data extraction steps were performed (agreement rate > 90%). We developed a data extraction grid to chart the data. Descriptive analyses were used to summarize quantitative data, and the authors conducted thematic analysis for qualitative data.</p><p><strong>Results: </strong>Based on 36 papers and 13 consultations, the team identified six steps characterizing trainee performance assessment based on reported observations in HPE: (1) making first contact, (2) observing and documenting the trainee performance, (3) collecting and completing assessment data, (4) aggregating assessment data, (5) inferring the level of competence, and (6) documenting and communicating the decision to the stakeholders.</p><p><strong>Discussion: </strong>The design and implementation of assessment based on reported observations is a first step towards a quality implementation by guiding educators and administrators responsible for graduating competent professionals. Future research might focus on understanding the context beyond assessor cognition to ensure the quality of meta-assessors' decisions.</p>\",\"PeriodicalId\":72503,\"journal\":{\"name\":\"Canadian medical education journal\",\"volume\":\"15 4\",\"pages\":\"63-75\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11415737/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Canadian medical education journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.36834/cmej.75522\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/8/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Canadian medical education journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.36834/cmej.75522","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/8/1 0:00:00","PubModel":"eCollection","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

背景:现在,教育工作者在评估受训者的表现时都会使用报告观察法。遗憾的是,他们对于如何设计和实施基于报告观察结果的评估却知之甚少:本范围综述的目的是梳理在评判卫生职业教育(HPE)受训者的表现时使用报告观察法的文献资料:方法:采用 Arksey 和 O'Malley(2005 年)的方法,使用四个数据库(来源:ERIC、CINAHL、MEDLINE、PsycINFO)。文章的资格标准为:英文或法文文献,包括原始数据,以及初始或专业培训;(2) HPE 项目培训;(3) 基于工作场所的评估;(4) 基于报告观察的评估。纳入/排除和数据提取步骤均已完成(一致率大于 90%)。我们制定了一个数据提取网格来绘制数据图表。描述性分析用于总结定量数据,作者对定性数据进行了主题分析:在 36 篇论文和 13 次咨询的基础上,研究小组根据所报告的 HPE 观察结果,确定了学员绩效评估的六个步骤:(1)首次接触;(2)观察并记录学员绩效;(3)收集并完成评估数据;(4)汇总评估数据;(5)推断能力水平;(6)记录并向利益相关者传达决定:讨论:根据报告的观察结果设计和实施评估,是指导负责培养合格专业人员的教育者和管理者高质量实施评估的第一步。未来的研究可能会侧重于了解评估者认知以外的背景,以确保元评估者决策的质量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Making judgments based on reported observations of trainee performance: a scoping review in Health Professions Education.

Background: Educators now use reported observations when assessing trainees' performance. Unfortunately, they have little information about how to design and implement assessments based on reported observations.

Objective: The purpose of this scoping review was to map the literature on the use of reported observations in judging health professions education (HPE) trainees' performances.

Methods: Arksey and O'Malley's (2005) method was used with four databases (sources: ERIC, CINAHL, MEDLINE, PsycINFO). Eligibility criteria for articles were: documents in English or French, including primary data, and initial or professional training; (2) training in an HPE program; (3) workplace-based assessment; and (4) assessment based on reported observations. The inclusion/exclusion, and data extraction steps were performed (agreement rate > 90%). We developed a data extraction grid to chart the data. Descriptive analyses were used to summarize quantitative data, and the authors conducted thematic analysis for qualitative data.

Results: Based on 36 papers and 13 consultations, the team identified six steps characterizing trainee performance assessment based on reported observations in HPE: (1) making first contact, (2) observing and documenting the trainee performance, (3) collecting and completing assessment data, (4) aggregating assessment data, (5) inferring the level of competence, and (6) documenting and communicating the decision to the stakeholders.

Discussion: The design and implementation of assessment based on reported observations is a first step towards a quality implementation by guiding educators and administrators responsible for graduating competent professionals. Future research might focus on understanding the context beyond assessor cognition to ensure the quality of meta-assessors' decisions.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
审稿时长
18 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信