评估实施措施(AIM):工具有效性之旅。

Amara Butt, Yawar Hayat Khan, Muhammad Zeeshan Baig
{"title":"评估实施措施(AIM):工具有效性之旅。","authors":"Amara Butt, Yawar Hayat Khan, Muhammad Zeeshan Baig","doi":"10.29271/jcpsp.2025.01.90","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>To establish the construct validity of the Assessment Implementation Measures (AIM) tool to accurately assess faculty perspectives on implemented assessment systems, facilitating the alignment with set standards.</p><p><strong>Study design: </strong>Qualitative Study. Place and Duration of the Study: The study was carried out at RIPHAH International University and data were collected from participants (senior faculty members) involved in teaching and assessment of undergraduates from various medical and dental colleges in Pakistan. Google form questionnaire was distributed using email and WhatsApp. The data were analysed using IBM AMOS SPSS version 24.</p><p><strong>Methodology: </strong>It was a 30-item tool. The sample size was calculated using 1:10 item-to-participant ratio. Hence data were collected from 313 participants. Confirmatory factor analysis was done to establish construct validity.</p><p><strong>Results: </strong>The indices of confirmatory factor analysis of the tool showed a discrepancy. To remove this discrepancy, items with weak item-loading values were removed. In the end, the tool was reduced to 13 items belonging to three domains.</p><p><strong>Conclusion: </strong>The final model was improved by excluding items from the original model. A re-validation study with a careful selection of experienced participants from various institutional backgrounds having baseline knowledge of medical education is suggested to improve the results.</p><p><strong>Key words: </strong>AIM Tool, Confirmatory factor analysis, Medical education, Assessment.</p>","PeriodicalId":94116,"journal":{"name":"Journal of the College of Physicians and Surgeons--Pakistan : JCPSP","volume":"35 1","pages":"90-94"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Assessment Implementation Measures (AIM): The Journey Towards the Tool Validity.\",\"authors\":\"Amara Butt, Yawar Hayat Khan, Muhammad Zeeshan Baig\",\"doi\":\"10.29271/jcpsp.2025.01.90\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>To establish the construct validity of the Assessment Implementation Measures (AIM) tool to accurately assess faculty perspectives on implemented assessment systems, facilitating the alignment with set standards.</p><p><strong>Study design: </strong>Qualitative Study. Place and Duration of the Study: The study was carried out at RIPHAH International University and data were collected from participants (senior faculty members) involved in teaching and assessment of undergraduates from various medical and dental colleges in Pakistan. Google form questionnaire was distributed using email and WhatsApp. The data were analysed using IBM AMOS SPSS version 24.</p><p><strong>Methodology: </strong>It was a 30-item tool. The sample size was calculated using 1:10 item-to-participant ratio. Hence data were collected from 313 participants. Confirmatory factor analysis was done to establish construct validity.</p><p><strong>Results: </strong>The indices of confirmatory factor analysis of the tool showed a discrepancy. To remove this discrepancy, items with weak item-loading values were removed. In the end, the tool was reduced to 13 items belonging to three domains.</p><p><strong>Conclusion: </strong>The final model was improved by excluding items from the original model. A re-validation study with a careful selection of experienced participants from various institutional backgrounds having baseline knowledge of medical education is suggested to improve the results.</p><p><strong>Key words: </strong>AIM Tool, Confirmatory factor analysis, Medical education, Assessment.</p>\",\"PeriodicalId\":94116,\"journal\":{\"name\":\"Journal of the College of Physicians and Surgeons--Pakistan : JCPSP\",\"volume\":\"35 1\",\"pages\":\"90-94\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of the College of Physicians and Surgeons--Pakistan : JCPSP\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.29271/jcpsp.2025.01.90\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the College of Physicians and Surgeons--Pakistan : JCPSP","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.29271/jcpsp.2025.01.90","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

目的:建立评估实施措施(AIM)工具的构建效度,以准确评估教师对实施评估系统的看法,促进与既定标准的一致。研究设计:定性研究。研究地点和时间:该研究在RIPHAH国际大学进行,数据收集自参与巴基斯坦各医学和牙科学院本科生教学和评估的参与者(高级教员)。谷歌表格问卷通过邮件和WhatsApp分发。采用IBM AMOS SPSS version 24对数据进行分析。方法:这是一个包含30个项目的工具。样本量采用1:10的项目与参与者比例计算。因此,从313名参与者中收集了数据。进行验证性因子分析以建立建构效度。结果:该工具的验证性因子分析指标存在差异。为了消除这种差异,删除了具有弱项目加载值的项目。最后,该工具被简化为属于三个领域的13个项目。结论:最终模型剔除了原模型中的项目,对模型进行了改进。建议重新验证研究,仔细选择来自不同机构背景、具有医学教育基础知识的有经验的参与者,以改善结果。关键词:AIM工具;验证性因子分析;医学教育;
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Assessment Implementation Measures (AIM): The Journey Towards the Tool Validity.

Objective: To establish the construct validity of the Assessment Implementation Measures (AIM) tool to accurately assess faculty perspectives on implemented assessment systems, facilitating the alignment with set standards.

Study design: Qualitative Study. Place and Duration of the Study: The study was carried out at RIPHAH International University and data were collected from participants (senior faculty members) involved in teaching and assessment of undergraduates from various medical and dental colleges in Pakistan. Google form questionnaire was distributed using email and WhatsApp. The data were analysed using IBM AMOS SPSS version 24.

Methodology: It was a 30-item tool. The sample size was calculated using 1:10 item-to-participant ratio. Hence data were collected from 313 participants. Confirmatory factor analysis was done to establish construct validity.

Results: The indices of confirmatory factor analysis of the tool showed a discrepancy. To remove this discrepancy, items with weak item-loading values were removed. In the end, the tool was reduced to 13 items belonging to three domains.

Conclusion: The final model was improved by excluding items from the original model. A re-validation study with a careful selection of experienced participants from various institutional backgrounds having baseline knowledge of medical education is suggested to improve the results.

Key words: AIM Tool, Confirmatory factor analysis, Medical education, Assessment.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信