The Data-Augmented, Technology-Assisted Medical Decision Making (DATA-MD) Curriculum: A Machine Learning and Artificial Intelligence Curriculum for Clinical Trainees.
Andrew Wong, Jeremy Sussman, Nicholson Price, Maggie Makar, Benjamin Li, Jun Yang, Cornelius James
{"title":"The Data-Augmented, Technology-Assisted Medical Decision Making (DATA-MD) Curriculum: A Machine Learning and Artificial Intelligence Curriculum for Clinical Trainees.","authors":"Andrew Wong, Jeremy Sussman, Nicholson Price, Maggie Makar, Benjamin Li, Jun Yang, Cornelius James","doi":"10.1097/ACM.0000000000006089","DOIUrl":null,"url":null,"abstract":"<p><strong>Problem: </strong>Despite the rapidly expanding role of artificial intelligence (AI) and machine learning (ML) in health care, a significant knowledge gap remains among clinicians in their ability to evaluate and use AI and ML tools.</p><p><strong>Approach: </strong>The Data-Augmented, Technology-Assisted Medical Decision Making (DATA-MD) curriculum was developed to teach fundamental AI and ML concepts to clinical trainees. The curriculum contains 4 modules: (1) Introduction to AI/ML in Healthcare, (2) Epidemiology and Biostatistics in AI/ML, (3) Use of AI/ML to Augment Diagnostic Decisions, and (4) Ethical and Legal Considerations of AI/ML in Healthcare. The curriculum was piloted in May and June 2023 among University of Michigan internal medicine residents and delivered to 2 cohorts of 11 and 12 residents. All learners completed presession and postsession assessments on AI and ML knowledge before and after the curriculum and a retrospective pre-post survey to evaluate familiarity with AI and ML concepts, comfort with AI and ML literature appraisal, and attitudes toward AI and ML use.</p><p><strong>Outcomes: </strong>Twenty of 23 learners (87%) completed the presession knowledge assessment before participating in the DATA-MD sessions, and all 23 learners completed the postsession knowledge assessment and retrospective pre-post survey. Median knowledge scores significantly improved for modules 1 to 3 (module 1: 2.5 to 3.0, P = .008; module 2: 1.0 to 2.0, P = .049; module 3: 2.0 to 3.0, P < .001) but not module 4 (2.0 before and after testing; P = .80). Learners reported increased confidence in their abilities to appraise the AI and ML literature and use AI and ML tools in future practice.</p><p><strong>Next steps: </strong>The DATA-MD curriculum pilot demonstrates that a standardized AI and ML curriculum can improve trainees' knowledge and attitudes about clinical AI and ML. Next steps include expansion to learners from different medical specialties, health professions, and academic institutions.</p>","PeriodicalId":50929,"journal":{"name":"Academic Medicine","volume":" ","pages":""},"PeriodicalIF":5.3000,"publicationDate":"2025-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Academic Medicine","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1097/ACM.0000000000006089","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0
Abstract
Problem: Despite the rapidly expanding role of artificial intelligence (AI) and machine learning (ML) in health care, a significant knowledge gap remains among clinicians in their ability to evaluate and use AI and ML tools.
Approach: The Data-Augmented, Technology-Assisted Medical Decision Making (DATA-MD) curriculum was developed to teach fundamental AI and ML concepts to clinical trainees. The curriculum contains 4 modules: (1) Introduction to AI/ML in Healthcare, (2) Epidemiology and Biostatistics in AI/ML, (3) Use of AI/ML to Augment Diagnostic Decisions, and (4) Ethical and Legal Considerations of AI/ML in Healthcare. The curriculum was piloted in May and June 2023 among University of Michigan internal medicine residents and delivered to 2 cohorts of 11 and 12 residents. All learners completed presession and postsession assessments on AI and ML knowledge before and after the curriculum and a retrospective pre-post survey to evaluate familiarity with AI and ML concepts, comfort with AI and ML literature appraisal, and attitudes toward AI and ML use.
Outcomes: Twenty of 23 learners (87%) completed the presession knowledge assessment before participating in the DATA-MD sessions, and all 23 learners completed the postsession knowledge assessment and retrospective pre-post survey. Median knowledge scores significantly improved for modules 1 to 3 (module 1: 2.5 to 3.0, P = .008; module 2: 1.0 to 2.0, P = .049; module 3: 2.0 to 3.0, P < .001) but not module 4 (2.0 before and after testing; P = .80). Learners reported increased confidence in their abilities to appraise the AI and ML literature and use AI and ML tools in future practice.
Next steps: The DATA-MD curriculum pilot demonstrates that a standardized AI and ML curriculum can improve trainees' knowledge and attitudes about clinical AI and ML. Next steps include expansion to learners from different medical specialties, health professions, and academic institutions.
期刊介绍：
Academic Medicine, the official peer-reviewed journal of the Association of American Medical Colleges, acts as an international forum for exchanging ideas, information, and strategies to address the significant challenges in academic medicine. The journal covers areas such as research, education, clinical care, community collaboration, and leadership, with a commitment to serving the public interest.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
