Use of the MERSQI to Evaluate ABFM Journal Club Articles

IF 3.2 3区管理学 Q1 EDUCATION & EDUCATIONAL RESEARCH

Education and Training Pub Date : 2023-01-01 DOI:10.1370/afm.21.s1.4073

Katherine Wright, S. Wheat, Zahra Qasem

{"title":"Use of the MERSQI to Evaluate ABFM Journal Club Articles","authors":"Katherine Wright, S. Wheat, Zahra Qasem","doi":"10.1370/afm.21.s1.4073","DOIUrl":null,"url":null,"abstract":"Context: To augment our research curriculum, our three family medicine residency programs participated in the American Board of Family Medicine (ABFM) Journal Club Pilot. We implemented the Medical Education Research Study Quality Instrument (MERSQI) to score journal articles and identify potential curriculum gaps. Objective: 1) summarize the body of literature included in the ABFM Journal Club Pilot by scoring each article for methodological quality; 2) identify research curriculum strengths and areas for growth Study Design: A bibliometric analysis was conducted to examine the methodologic quality of research studies included in the ABFM Journal Club Pilot. Additionally, we surveyed residents to document their confidence critically appraising journal articles. Dataset: MERSQI quality scores were calculated for 40 studies published in 25 journals selected by the ABFM. Intervention/Instrument: The 10-item MERSQI was used to assess methodological quality across six domains: study design, sampling (number of institutions and response rate), type of data, validity (internal structure, content, and relationships to other variables), data analysis (appropriateness and complexity), and outcomes. Previous studies document strong validity evidence for the MERSQI. The resident survey included 12 Likert scale items measuring confidence appraising different elements of journal club articles (e.g. interpreting confidence intervals, statistical power, etc.). Results: MERSQI scores ranged from 13 to 18, with the average being 16.31 (higher scores indicate higher quality). A majority of articles (80%) implemented a randomized control trial. Most articles (82%) with a survey had a response rate of 75% or above. Most studies were multi-institutional (90%) and presented objective measurements (87.2%) as opposed to self-assessment data alone (12.8%). At baseline before implementing the journal club pilot, a majority of residents indicated they had none or minimal experience evaluating journal articles (n=22, 52.4%). Conclusions: On average, ABFM journal club articles had relatively high MERSQI scores compared to other bibliometric","PeriodicalId":47994,"journal":{"name":"Education and Training","volume":"34 1","pages":""},"PeriodicalIF":3.2000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Education and Training","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1370/afm.21.s1.4073","RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}

引用次数: 0

Abstract

Context: To augment our research curriculum, our three family medicine residency programs participated in the American Board of Family Medicine (ABFM) Journal Club Pilot. We implemented the Medical Education Research Study Quality Instrument (MERSQI) to score journal articles and identify potential curriculum gaps. Objective: 1) summarize the body of literature included in the ABFM Journal Club Pilot by scoring each article for methodological quality; 2) identify research curriculum strengths and areas for growth Study Design: A bibliometric analysis was conducted to examine the methodologic quality of research studies included in the ABFM Journal Club Pilot. Additionally, we surveyed residents to document their confidence critically appraising journal articles. Dataset: MERSQI quality scores were calculated for 40 studies published in 25 journals selected by the ABFM. Intervention/Instrument: The 10-item MERSQI was used to assess methodological quality across six domains: study design, sampling (number of institutions and response rate), type of data, validity (internal structure, content, and relationships to other variables), data analysis (appropriateness and complexity), and outcomes. Previous studies document strong validity evidence for the MERSQI. The resident survey included 12 Likert scale items measuring confidence appraising different elements of journal club articles (e.g. interpreting confidence intervals, statistical power, etc.). Results: MERSQI scores ranged from 13 to 18, with the average being 16.31 (higher scores indicate higher quality). A majority of articles (80%) implemented a randomized control trial. Most articles (82%) with a survey had a response rate of 75% or above. Most studies were multi-institutional (90%) and presented objective measurements (87.2%) as opposed to self-assessment data alone (12.8%). At baseline before implementing the journal club pilot, a majority of residents indicated they had none or minimal experience evaluating journal articles (n=22, 52.4%). Conclusions: On average, ABFM journal club articles had relatively high MERSQI scores compared to other bibliometric

查看原文本刊更多论文

使用MERSQI评估ABFM期刊俱乐部文章

背景:为了增加我们的研究课程，我们的三个家庭医学住院医师项目参加了美国家庭医学委员会(ABFM)期刊俱乐部试点项目。我们采用医学教育研究质量工具(MERSQI)对期刊文章进行评分，并确定潜在的课程差距。目的:1)通过对每篇文章的方法学质量评分，总结ABFM期刊俱乐部试点纳入的文献主体;2)确定研究课程的优势和发展领域研究设计:进行文献计量学分析，以检查ABFM期刊俱乐部试点项目中研究的方法学质量。此外，我们对居民进行了调查，以记录他们对批判性评价期刊文章的信心。数据集:MERSQI质量评分是由ABFM选择的25种期刊上发表的40项研究计算的。干预/工具:10项MERSQI用于评估六个领域的方法学质量:研究设计、抽样(机构数量和回复率)、数据类型、有效性(内部结构、内容和与其他变量的关系)、数据分析(适当性和复杂性)和结果。先前的研究为MERSQI提供了强有力的有效性证据。居民调查包括12个李克特量表项目，测量对期刊俱乐部文章的不同要素(如解释置信区间、统计功率等)的置信度。结果:MERSQI评分范围为13 ~ 18分，平均分为16.31分(得分越高，质量越好)。大多数文章(80%)采用随机对照试验。大多数带有调查的文章(82%)的回复率为75%或以上。大多数研究是多机构的(90%)，提供客观测量(87.2%)，而不是单独的自我评估数据(12.8%)。在实施期刊俱乐部试点之前的基线，大多数居民表示他们没有或很少有评估期刊文章的经验(n=22, 52.4%)。结论:平均而言，与其他文献计量学相比，ABFM期刊俱乐部文章的MERSQI得分相对较高

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Education and Training EDUCATION & EDUCATIONAL RESEARCH-

CiteScore

7.20

自引率

13.90%

发文量

期刊介绍： Education + Training addresses the increasingly complex relationships between education, training and employment and the impact of these relationships on national and global labour markets. The journal gives specific consideration to young people, looking at how the transition from school/college to employment is achieved and how the nature of partnerships between the worlds of education and work continues to evolve. The journal explores vocationalism in learning and efforts to address employability within the curriculum, together with coverage of innovative themes and initiatives within vocational education and training. The journal is read by policy makers, educators and academics working in a wide range of fields including education, learning and skills development, enterprise and entrepreneurship education and training, induction and career development. Coverage: Managing the transition from school/college to work New initiatives in post 16 vocational education and training Education-Business partnerships and collaboration Links between education and industry The graduate labour market Work experience and placements The recruitment, induction and development of school leavers and graduates Young person employability and career development E learning in further and higher education Research news Reviews of recent publications.