Janeve Desy, Adrian Harvey, Sarah Weeks, Kevin D Busche, Kerri Martin, Michael Paget, Christopher Naugler, Kevin McLaughlin
{"title":"The impact of systematically repairing multiple choice questions with low discrimination on assessment reliability: an interrupted time series analysis.","authors":"Janeve Desy, Adrian Harvey, Sarah Weeks, Kevin D Busche, Kerri Martin, Michael Paget, Christopher Naugler, Kevin McLaughlin","doi":"10.36834/cmej.77596","DOIUrl":"10.36834/cmej.77596","url":null,"abstract":"<p><p>At our centre, we introduced a continuous quality improvement (CQI) initiative during academic year 2018-19 targeting for repair multiple choice question (MCQ) items with discrimination index (<i>D</i>) < 0.1. The purpose of this study was to assess the impact of this initiative on reliability/internal consistency of our assessments. Our participants were medical students during academic years 2015-16 to 2020-21 and our data were summative MCQ assessments during this time. Since the goal was to systematically review and improve summative assessments in our undergraduate program on an ongoing basis, we used interrupted time series analysis to assess the impact on reliability. Between 2015-16 and 2017-18 there was a significant negative trend in the mean alpha coefficient for MCQ exams (regression coefficient -0.027 [-0.008, -0.047], <i>p</i> = 0.024). In the academic year following the introduction of our initiative (2018-19) there was a significant increase in the mean alpha coefficient (regression coefficient 0.113 [0.063, 0.163], <i>p</i> = 0.010) which was then followed by a significant positive post-intervention trend (regression coefficient 0.056 [0.037, 0.075], <i>p</i> = 0.006). In conclusion, our CQI intervention resulted in an immediate and progressive improvement reliability of our MCQ assessments.</p>","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11302750/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Marco Zaccagnini, Erin Cameron, Roger Strasser, Saleem Razack, Tim Dubé
{"title":"Educational approaches for social accountability in health professions training: a scoping review protocol.","authors":"Marco Zaccagnini, Erin Cameron, Roger Strasser, Saleem Razack, Tim Dubé","doi":"10.36834/cmej.78911","DOIUrl":"10.36834/cmej.78911","url":null,"abstract":"","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11302764/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903798","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Large language models in medical education: new tools for experimentation and discovery.","authors":"Akshay Rajaram","doi":"10.36834/cmej.78879","DOIUrl":"10.36834/cmej.78879","url":null,"abstract":"","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11302760/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903803","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"<i>Walk with a Future Doc</i> program allows Canadian medical students to promote physical activity and health education in local communities.","authors":"Taylor M Wilson, Olga Theou, Myles W O'Brien","doi":"10.36834/cmej.77055","DOIUrl":"10.36834/cmej.77055","url":null,"abstract":"<p><p>Medical student-led walk and talk programs, such as <i>Walk with a Future Doc (WWAFD)</i>, provide a means for the medical community and community at-large to interact in a non-clinical setting. This environment can increase attendance accountability, enhance patient-provider relationships, and allow medical professionals to be leading examples of healthy, active living. We demonstrate the positive interest for this program, rationale of participants for joining, and the feasibility of its setup. As one of the only <i>WWAFD</i> programs in Canada, we encourage other medical schools to implement this program to promote continuity of hands-on, community-engaged learning amongst their students.</p>","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11302763/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903795","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Candelaria Aristizabal Londono, Chun Huang, Garson Chan
{"title":"Harnessing Artificial Intelligence's potential in undergraduate medical education: an analysis of application and implication.","authors":"Candelaria Aristizabal Londono, Chun Huang, Garson Chan","doi":"10.36834/cmej.78483","DOIUrl":"10.36834/cmej.78483","url":null,"abstract":"","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11302769/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903801","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Reem El Sherif, Ian Shrier, Pierre Paul-Tellier, Charo Rodriguez
{"title":"What do we know about Objective Structured Clinical Examination in Sport and Exercise Medicine? A scoping review.","authors":"Reem El Sherif, Ian Shrier, Pierre Paul-Tellier, Charo Rodriguez","doi":"10.36834/cmej.77841","DOIUrl":"10.36834/cmej.77841","url":null,"abstract":"<p><strong>Background and objectives: </strong>Despite the importance of the Objective Structured Clinical Examination (OSCE) in Sport and Exercise Medicine, the literature on the topic is fragmented and has been poorly developed. The goal of this review was to map current knowledge about how the OSCE is used in Sport and Exercise Medicine, and to identify knowledge gaps for future research.</p><p><strong>Method: </strong>The authors conducted a scoping review. They searched PubMed and Scopus for articles using key terms related to 'OSCE' and 'sport medicine' with no limit on search start date and up to July 2022. Retrieved records were imported, abstracts were screened, and full-text articles were reviewed. A forward and backward citation tracking was conducted. Data was extracted and a qualitative meta-summary of the studies was conducted.</p><p><strong>Results: </strong>A total of 469 records were screened, and 22 studies were included. The objectives of the studies included using OSCEs to assess knowledge/skills after a training program (<i>n</i> = 11), to assess an intervention (<i>n</i> = 8), and to assess and improve the OSCE itself (<i>n</i> = 3). Thirteen studies reported validity and/or reliability of the OSCE.</p><p><strong>Conclusion: </strong>Despite the widespread use of OSCEs in the examination of Sport and Exercise Medicine trainees, only a handful of scholarly works have been published. More research is needed to support the use of OSCE in Sport and Exercise Medicine for its initial purpose. We highlight avenues for future research such as assessing the need for a deeper exploration of the relationship between candidate characteristics and OSCE scores.</p>","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11302755/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903810","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"International Congress on Academic Medicine: 2024 medical education abstracts.","authors":"","doi":"10.36834/cmej.79446","DOIUrl":"https://doi.org/10.36834/cmej.79446","url":null,"abstract":"","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11302768/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903802","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Threads of Life.","authors":"Nicole S Graziano","doi":"10.36834/cmej.79215","DOIUrl":"https://doi.org/10.36834/cmej.79215","url":null,"abstract":"","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11302749/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903808","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"\"Everything new is happening all at once\": a qualitative study of early career obstetrician and gynaecologists' preparedness for independent practice.","authors":"Nicole Wiebe, Andrea Hunt, Taryn Taylor","doi":"10.36834/cmej.77329","DOIUrl":"10.36834/cmej.77329","url":null,"abstract":"<p><strong>Background: </strong>The transition from residency training into practice is associated with increasing risks of litigation, burnout, and stress. Yet, we know very little about how best to prepare graduates for the full scope of independent practice, beyond ensuring clinical competence. Thus, we explored the transition to independent practice (TTP) experiences of recent Obstetrics and Gynaecology graduates to understand potential gaps in their perceived readiness for practice.</p><p><strong>Methods: </strong>Using constructivist grounded theory, we conducted semi-structured interviews with 20 Obstetricians/Gynaecologists who graduated from nine Canadian residency programs within the last five years. Iterative data collection and analysis led to the development of key themes.</p><p><strong>Results: </strong>Five key themes encompassed different practice gaps experienced by participants throughout their transition. These practice gaps fit into five competency domains: providing clinical care, such as managing unfamiliar low-risk ambulatory presentations; navigating logistics, such as triaging referrals; managing administration, such as hiring or firing support staff; reclaiming personhood, such as boundary-setting between work and home; and bearing ultimate responsibility, such as navigating patient complaints. Mitigating factors were found to widen or narrow the extent to which new graduates experienced a practice gap. There was a shared sense among participants that some practice gaps were impossible to resolve during training.</p><p><strong>Conclusions: </strong>Existing practice gaps are multi-dimensional and perhaps not realistically addressed during residency. Instead, TTP mentorship and training opportunities must extend beyond residency to ensure that new graduates are equipped for the full breadth of independent practice.</p>","PeriodicalId":72503,"journal":{"name":"Canadian medical education journal","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11302748/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}