[评估正畸医生能力的情景任务验证(以合并颌畸形病例为例)]。

Q4 Medicine
A V Malervein, A V Kochubey, O Y Bogaevskaya, V V Kochubey, M I Lazechko
{"title":"[评估正畸医生能力的情景任务验证(以合并颌畸形病例为例)]。","authors":"A V Malervein, A V Kochubey, O Y Bogaevskaya, V V Kochubey, M I Lazechko","doi":"10.17116/stomat202510401137","DOIUrl":null,"url":null,"abstract":"<p><strong>The aim the study: </strong>The choice of situational tasks to assess the knowledge of orthodontists about the management of patients with combined jaw deformities.</p><p><strong>Materials and methods: </strong>An expert assessment of 13 situational tasks was carried out in relation to three categories: validity - compliance with real cases in clinical practice, clarity - a complete and adequate description of the case; complexity - the difficulty of solving the problem. The assessment by category was performed on a rating six-point scale based on a calculated integral coefficient (IC) equal to the sum of the ratings by category.</p><p><strong>Results: </strong>The values of the Integral coefficient of the first round of estimates differ significantly, <i>p</i>≤0.001. The Duncan test identifies 9 homogeneous subsets. The estimates of tasks No. 10, 1, 9, 4, 3, 11 simultaneously form 4 groups of subsets for which a second round of evaluation is made. The integral coefficient of the points of the second round of the expert assessment is significantly different, <i>p</i>≤0.001. The Duncan test identifies 2 homogeneous subsets. The experts rated task No. 3 significantly higher (M=10.9). The integral coefficient of the third round of assessments of tasks 3.12.13 is significantly different, <i>p</i>=0.023, «reasonableness» (<i>p</i>=0.815) and «clarity» (<i>p</i>= 0.082) do not differ, the \"complexity\" of task 13 is higher than that of task 3 (<i>p</i>=0.026), differences in the \"complexity\" of tasks 3 and 12 (<i>p</i>=0.209), 12 and 13 (<i>p</i>=0.383) no. In the first round, the reasonableness (3.23±1.34 points), complexity (3.15±1.26), clarity (3.04±1.15) of the tasks did not significantly differ (0.055≤<i>p</i>≤0.422). In the second round, the reasonableness (2.98±0.89) of the tasks is higher than their complexity (2.52±0.86) and clarity (2.54±0.74), (<i>p</i>=0.005 and <i>p</i>=0.003), but the complexity and clarity of the tasks are the same (<i>t</i>=0.18, <i>p</i>=0.860). Reasonableness (5.67±0.48), complexity (5.38±0.49) and clarity (5.62±0.49) do not differ in the third round (0.058≤<i>p</i>≤0.763).</p><p><strong>Conclusion: </strong>The situational tasks selected in the study are distinguished by an integral coefficient of validity, complexity and clarity higher than other evaluated tasks, which allows for a multi-level assessment of the knowledge of orthodontists in the management of patients with combined dental anomalies. Expert assessment is acceptable for validating situational tasks when identifying assessment categories.</p>","PeriodicalId":35887,"journal":{"name":"Stomatologiya","volume":"104 1","pages":"37-41"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"[Validation of situational tasks to assess the competence of orthodontists (using the example of cases of combined jaw deformity)].\",\"authors\":\"A V Malervein, A V Kochubey, O Y Bogaevskaya, V V Kochubey, M I Lazechko\",\"doi\":\"10.17116/stomat202510401137\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>The aim the study: </strong>The choice of situational tasks to assess the knowledge of orthodontists about the management of patients with combined jaw deformities.</p><p><strong>Materials and methods: </strong>An expert assessment of 13 situational tasks was carried out in relation to three categories: validity - compliance with real cases in clinical practice, clarity - a complete and adequate description of the case; complexity - the difficulty of solving the problem. The assessment by category was performed on a rating six-point scale based on a calculated integral coefficient (IC) equal to the sum of the ratings by category.</p><p><strong>Results: </strong>The values of the Integral coefficient of the first round of estimates differ significantly, <i>p</i>≤0.001. The Duncan test identifies 9 homogeneous subsets. The estimates of tasks No. 10, 1, 9, 4, 3, 11 simultaneously form 4 groups of subsets for which a second round of evaluation is made. The integral coefficient of the points of the second round of the expert assessment is significantly different, <i>p</i>≤0.001. The Duncan test identifies 2 homogeneous subsets. The experts rated task No. 3 significantly higher (M=10.9). The integral coefficient of the third round of assessments of tasks 3.12.13 is significantly different, <i>p</i>=0.023, «reasonableness» (<i>p</i>=0.815) and «clarity» (<i>p</i>= 0.082) do not differ, the \\\"complexity\\\" of task 13 is higher than that of task 3 (<i>p</i>=0.026), differences in the \\\"complexity\\\" of tasks 3 and 12 (<i>p</i>=0.209), 12 and 13 (<i>p</i>=0.383) no. In the first round, the reasonableness (3.23±1.34 points), complexity (3.15±1.26), clarity (3.04±1.15) of the tasks did not significantly differ (0.055≤<i>p</i>≤0.422). In the second round, the reasonableness (2.98±0.89) of the tasks is higher than their complexity (2.52±0.86) and clarity (2.54±0.74), (<i>p</i>=0.005 and <i>p</i>=0.003), but the complexity and clarity of the tasks are the same (<i>t</i>=0.18, <i>p</i>=0.860). Reasonableness (5.67±0.48), complexity (5.38±0.49) and clarity (5.62±0.49) do not differ in the third round (0.058≤<i>p</i>≤0.763).</p><p><strong>Conclusion: </strong>The situational tasks selected in the study are distinguished by an integral coefficient of validity, complexity and clarity higher than other evaluated tasks, which allows for a multi-level assessment of the knowledge of orthodontists in the management of patients with combined dental anomalies. Expert assessment is acceptable for validating situational tasks when identifying assessment categories.</p>\",\"PeriodicalId\":35887,\"journal\":{\"name\":\"Stomatologiya\",\"volume\":\"104 1\",\"pages\":\"37-41\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Stomatologiya\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.17116/stomat202510401137\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"Medicine\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Stomatologiya","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.17116/stomat202510401137","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0

摘要

研究的目的是:情境任务的选择来评估正畸医生对合并颌骨畸形患者的管理知识。材料和方法:对13个情境任务进行了专家评估,涉及三个类别:有效性-符合临床实践中的真实病例,清晰度-对病例的完整和充分描述;复杂性——解决问题的难度。按类别进行的评估是根据计算出的积分系数(IC)按6分制进行的,该积分系数等于按类别的评级之和。结果:第一轮估计的积分系数值差异显著,p≤0.001。邓肯检验确定了9个齐次子集。任务10、1、9、4、3、11的估计数同时构成4组子集,对它们进行第二轮评价。第二轮专家评价的积分系数有显著性差异,p≤0.001。邓肯检验确定了2个齐次子集。专家们对任务3的评价明显更高(M=10.9)。任务3.12.13第三轮评估的积分系数有显著差异,p=0.023,“合理性”(p=0.815)和“清晰性”(p= 0.082)没有差异,任务13的“复杂性”高于任务3 (p=0.026),任务3和任务12的“复杂性”(p=0.209),任务12和任务13 (p=0.383)没有差异。第一轮任务的合理性(3.23±1.34分)、复杂性(3.15±1.26分)、清晰度(3.04±1.15分)差异无统计学意义(0.055≤p≤0.422)。在第二轮中,任务的合理性(2.98±0.89)高于任务的复杂性(2.52±0.86)和清晰度(2.54±0.74)(p=0.005和p=0.003),但任务的复杂性和清晰度相同(t=0.18, p=0.860)。合理性(5.67±0.48)、复杂性(5.38±0.49)和清晰度(5.62±0.49)在第三轮无差异(0.058≤p≤0.763)。结论:本研究选择的情境任务具有较高的效度、复杂性和清晰度的积分系数,可对正畸医师对合并牙畸形患者的管理知识进行多层次评估。在确定评估类别时,可以接受专家评估来验证情景任务。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
[Validation of situational tasks to assess the competence of orthodontists (using the example of cases of combined jaw deformity)].

The aim the study: The choice of situational tasks to assess the knowledge of orthodontists about the management of patients with combined jaw deformities.

Materials and methods: An expert assessment of 13 situational tasks was carried out in relation to three categories: validity - compliance with real cases in clinical practice, clarity - a complete and adequate description of the case; complexity - the difficulty of solving the problem. The assessment by category was performed on a rating six-point scale based on a calculated integral coefficient (IC) equal to the sum of the ratings by category.

Results: The values of the Integral coefficient of the first round of estimates differ significantly, p≤0.001. The Duncan test identifies 9 homogeneous subsets. The estimates of tasks No. 10, 1, 9, 4, 3, 11 simultaneously form 4 groups of subsets for which a second round of evaluation is made. The integral coefficient of the points of the second round of the expert assessment is significantly different, p≤0.001. The Duncan test identifies 2 homogeneous subsets. The experts rated task No. 3 significantly higher (M=10.9). The integral coefficient of the third round of assessments of tasks 3.12.13 is significantly different, p=0.023, «reasonableness» (p=0.815) and «clarity» (p= 0.082) do not differ, the "complexity" of task 13 is higher than that of task 3 (p=0.026), differences in the "complexity" of tasks 3 and 12 (p=0.209), 12 and 13 (p=0.383) no. In the first round, the reasonableness (3.23±1.34 points), complexity (3.15±1.26), clarity (3.04±1.15) of the tasks did not significantly differ (0.055≤p≤0.422). In the second round, the reasonableness (2.98±0.89) of the tasks is higher than their complexity (2.52±0.86) and clarity (2.54±0.74), (p=0.005 and p=0.003), but the complexity and clarity of the tasks are the same (t=0.18, p=0.860). Reasonableness (5.67±0.48), complexity (5.38±0.49) and clarity (5.62±0.49) do not differ in the third round (0.058≤p≤0.763).

Conclusion: The situational tasks selected in the study are distinguished by an integral coefficient of validity, complexity and clarity higher than other evaluated tasks, which allows for a multi-level assessment of the knowledge of orthodontists in the management of patients with combined dental anomalies. Expert assessment is acceptable for validating situational tasks when identifying assessment categories.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Stomatologiya
Stomatologiya Medicine-Medicine (all)
CiteScore
0.40
自引率
0.00%
发文量
93
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信