JMIR Medical Education最新文献

筛选
英文 中文
A Language Model-Powered Simulated Patient With Automated Feedback for History Taking: Prospective Study. 语言模型驱动的模拟病人,自动反馈病史采集:前瞻性研究
IF 3.2
JMIR Medical Education Pub Date : 2024-08-16 DOI: 10.2196/59213
Friederike Holderried, Christian Stegemann-Philipps, Anne Herrmann-Werner, Teresa Festl-Wietek, Martin Holderried, Carsten Eickhoff, Moritz Mahling
{"title":"A Language Model-Powered Simulated Patient With Automated Feedback for History Taking: Prospective Study.","authors":"Friederike Holderried, Christian Stegemann-Philipps, Anne Herrmann-Werner, Teresa Festl-Wietek, Martin Holderried, Carsten Eickhoff, Moritz Mahling","doi":"10.2196/59213","DOIUrl":"10.2196/59213","url":null,"abstract":"<p><strong>Background: </strong>Although history taking is fundamental for diagnosing medical conditions, teaching and providing feedback on the skill can be challenging due to resource constraints. Virtual simulated patients and web-based chatbots have thus emerged as educational tools, with recent advancements in artificial intelligence (AI) such as large language models (LLMs) enhancing their realism and potential to provide feedback.</p><p><strong>Objective: </strong>In our study, we aimed to evaluate the effectiveness of a Generative Pretrained Transformer (GPT) 4 model to provide structured feedback on medical students' performance in history taking with a simulated patient.</p><p><strong>Methods: </strong>We conducted a prospective study involving medical students performing history taking with a GPT-powered chatbot. To that end, we designed a chatbot to simulate patients' responses and provide immediate feedback on the comprehensiveness of the students' history taking. Students' interactions with the chatbot were analyzed, and feedback from the chatbot was compared with feedback from a human rater. We measured interrater reliability and performed a descriptive analysis to assess the quality of feedback.</p><p><strong>Results: </strong>Most of the study's participants were in their third year of medical school. A total of 1894 question-answer pairs from 106 conversations were included in our analysis. GPT-4's role-play and responses were medically plausible in more than 99% of cases. Interrater reliability between GPT-4 and the human rater showed \"almost perfect\" agreement (Cohen κ=0.832). Less agreement (κ<0.6) detected for 8 out of 45 feedback categories highlighted topics about which the model's assessments were overly specific or diverged from human judgement.</p><p><strong>Conclusions: </strong>The GPT model was effective in providing structured feedback on history-taking dialogs provided by medical students. Although we unraveled some limitations regarding the specificity of feedback for certain feedback categories, the overall high agreement with human raters suggests that LLMs can be a valuable tool for medical education. Our findings, thus, advocate the careful integration of AI-driven feedback mechanisms in medical training and highlight important aspects when LLMs are used in that context.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11364946/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141989103","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bridging the Gap: A Mixed-Method Study on Gender and Sexuality Awareness in Medical Education and Practice. 缩小差距:关于医学教育与实践中的性别和性意识的混合方法研究》(Bridging the Gap: A Mixed-Method Study on Gender and Sexuality Awareness in Medical Education and Practice)。
IF 3.2
JMIR Medical Education Pub Date : 2024-08-16 DOI: 10.2196/59009
Rola Khamisy-Farah, Eden Biras, Rabie Shehadeh, Ruba Tuma, Hisham Atwan, Anna Siri, Manlio Converti, Francesco Chirico, Lukasz Szarpak, Carlo Biz, Raymond Farah, Nicola Bragazzi
{"title":"Bridging the Gap: A Mixed-Method Study on Gender and Sexuality Awareness in Medical Education and Practice.","authors":"Rola Khamisy-Farah, Eden Biras, Rabie Shehadeh, Ruba Tuma, Hisham Atwan, Anna Siri, Manlio Converti, Francesco Chirico, Lukasz Szarpak, Carlo Biz, Raymond Farah, Nicola Bragazzi","doi":"10.2196/59009","DOIUrl":"https://doi.org/10.2196/59009","url":null,"abstract":"<p><strong>Background: </strong>The integration of gender and sexuality awareness in healthcare is increasingly recognized as vital for patient outcomes. Despite this, there is a notable lack of comprehensive data on the current state of physicians' training and perceptions in these areas, leading to a gap in targeted educational interventions and optimal healthcare delivery.</p><p><strong>Objective: </strong>The study's aim was to explore the experiences and perceptions of attending and resident physicians regarding the inclusion of gender and sexuality content in medical school curricula and professional practice in Israel.</p><p><strong>Methods: </strong>This cross-sectional survey targeted a diverse group of physicians across various specializations and experience levels. Distributed through Israeli medical associations and professional networks, it included sections on experiences with gender and sexuality content, perceptions of knowledge, the impact of medical school curricula on professional capabilities, and views on integrating gender medicine in medical education. Descriptive and correlational analyses, along with gender-based and medical status-based comparisons, were employed, complemented and enhanced by qualitative analysis of participants' replies.</p><p><strong>Results: </strong>The survey, encompassing 189 respondents, revealed low-to-moderate exposure to gender and sexuality content in medical school curricula, with a similar perception of preparedness. A need for more comprehensive training was widely recognized. The majority valued training in these areas for enhancing professional capabilities, identifying ten essential gender-related knowledge areas. The preference for integrating gender medicine throughout medical education was significant. Gender-based analysis indicated variations in exposure and perceptions.</p><p><strong>Conclusions: </strong>The study highlights a crucial need for the inclusion of gender and sexuality awareness in medical education and practice. It suggests the necessity for curriculum development, targeted training programs, policy advocacy, mentorship initiatives, and research to evaluate the effectiveness of these interventions. The findings serve as a foundation for future directions in medical education, aiming for a more inclusive, aware, and prepared medical workforce.</p><p><strong>Clinicaltrial: </strong></p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141996614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reforming China's Secondary Vocational Medical Education: Adapting to the Challenges and Opportunities of the AI Era. 中国中等职业医学教育改革:适应人工智能时代的挑战与机遇》。
IF 3.2
JMIR Medical Education Pub Date : 2024-08-15 DOI: 10.2196/48594
Wenting Tong, Xiaowen Zhang, Haiping Zeng, Jianping Pan, Chao Gong, Hui Zhang
{"title":"Reforming China's Secondary Vocational Medical Education: Adapting to the Challenges and Opportunities of the AI Era.","authors":"Wenting Tong, Xiaowen Zhang, Haiping Zeng, Jianping Pan, Chao Gong, Hui Zhang","doi":"10.2196/48594","DOIUrl":"10.2196/48594","url":null,"abstract":"<p><strong>Unlabelled: </strong>China's secondary vocational medical education is essential for training primary health care personnel and enhancing public health responses. This education system currently faces challenges, primarily due to its emphasis on knowledge acquisition that overshadows the development and application of skills, especially in the context of emerging artificial intelligence (AI) technologies. This article delves into the impact of AI on medical practices and uses this analysis to suggest reforms for the vocational medical education system in China. AI is found to significantly enhance diagnostic capabilities, therapeutic decision-making, and patient management. However, it also brings about concerns such as potential job losses and necessitates the adaptation of medical professionals to new technologies. Proposed reforms include a greater focus on critical thinking, hands-on experiences, skill development, medical ethics, and integrating humanities and AI into the curriculum. These reforms require ongoing evaluation and sustained research to effectively prepare medical students for future challenges in the field.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11337726/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141989105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Teaching Digital Medicine to Undergraduate Medical Students with an Interprofessional and Interdisciplinary Approach: A Proof of Concept Study. 以跨专业和跨学科方法向医学本科生教授数字医学:概念验证研究。
IF 3.2
JMIR Medical Education Pub Date : 2024-08-14 DOI: 10.2196/56787
Annabelle Mielitz, Ulf Kulau, Lucas Bublitz, Anja Bittner, Hendrik Friederichs, Urs-Vito Albrecht
{"title":"Teaching Digital Medicine to Undergraduate Medical Students with an Interprofessional and Interdisciplinary Approach: A Proof of Concept Study.","authors":"Annabelle Mielitz, Ulf Kulau, Lucas Bublitz, Anja Bittner, Hendrik Friederichs, Urs-Vito Albrecht","doi":"10.2196/56787","DOIUrl":"https://doi.org/10.2196/56787","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;An integration of digital medicine into medical education can help future doctors to shape the digital transformation of medicine.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;A newly developed course for teaching digital medicine (Bielefeld model) is described and evaluated for the first time.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;The course was held with undergraduate medical students at Medical School OWL at Bielefeld University, Germany, in 2023, and evaluated via pre-post surveys. The subjective and objective achievement of superordinate learning objectives and the objective achievement of subordinate learning objectives of the course, course design and course importance were evaluated utilizing five-point Likert scales (1=\"strongly disagree\", 5=\"strongly agree\"), a multiple choice format for reasons of absence, and open comments. The superordinate objectives comprise the understanding of factors driving the implementation of digital medical products and processes (1), the application of this knowledge to a project (2), and the empowerment to design such solutions (3) in the future. The subordinate objectives comprise competencies related to the first superordinate objective.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;10 undergraduate medical students (male: 4, female: 6, mean age 21.7 years, SD: 2.1 years) evaluated the course. The superordinate objectives were achieved well to very well: the medians for the objective achievement were 4 scale units (su) (IQR 4-5 su), 4 su (IQR 3-5 su) and 4 su (IQR 4-4 su) for the first, second and third objective and the medians for the subjective achievement of the first, second and third objective were 4 su (IQR 3-4 su), 4.5 su (IQR 3-5 su) and 4 su (IQR 3-5 su). Participants mastered the subordinate objectives, averagely, better after the course than before (pre-survey median:2.5 su (IQR 2-3 su), post-survey median: 4 su (IQR 3-4 su)). The course concept was rated as highly suitable for achieving the superordinate objectives (medians: 5 su (IQR 4-5 su) for the first, second, and third objective). On average, the students highly liked the course (median: 5 su (IQR 4-5 su)) and gained a benefit from (median: 4.5 su (IQR 4-5 su)). All students fully agreed that the teaching staff was a strength of the course. The category \"Positive feedback on the course or positive personal experience with the course\" received most comments.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;The course framework exhibits promise in attaining learning objectives within the realm of digital medicine, notwithstanding the constraint of limited interpretability arising from a small sample size and further limitations. It aligns with insights derived from teaching and learning research and the domain of digital medicine, albeit with identifiable areas for enhancement. A literature review indicates a dearth of publications pertaining to analogous courses in Germany. Future investigations should entail a more exhaustive evaluation of the co","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142074128","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Impact of a New Gynecologic Oncology Hashtag During Virtual-Only ASCO Annual Meetings: An X (Twitter) Social Network Analysis. 新的妇科肿瘤学标签在虚拟ASCO年会期间的影响:X(Twitter)社交网络分析。
IF 3.2
JMIR Medical Education Pub Date : 2024-08-14 DOI: 10.2196/45291
Geetu Bhandoria, Esra Bilir, Christina Uwins, Josep Vidal-Alaball, Aïna Fuster-Casanovas, Wasim Ahmed
{"title":"Impact of a New Gynecologic Oncology Hashtag During Virtual-Only ASCO Annual Meetings: An X (Twitter) Social Network Analysis.","authors":"Geetu Bhandoria, Esra Bilir, Christina Uwins, Josep Vidal-Alaball, Aïna Fuster-Casanovas, Wasim Ahmed","doi":"10.2196/45291","DOIUrl":"10.2196/45291","url":null,"abstract":"<p><strong>Background: </strong>Official conference hashtags are commonly used to promote tweeting and social media engagement. The reach and impact of introducing a new hashtag during an oncology conference have yet to be studied. The American Society of Clinical Oncology (ASCO) conducts an annual global meeting, which was entirely virtual due to the COVID-19 pandemic in 2020 and 2021.</p><p><strong>Objective: </strong>This study aimed to assess the reach and impact (in the form of vertices and edges generated) and X (formerly Twitter) activity of the new hashtags #goASCO20 and #goASCO21 in the ASCO 2020 and 2021 virtual conferences.</p><p><strong>Methods: </strong>New hashtags (#goASCO20 and #goASCO21) were created for the ASCO virtual conferences in 2020 and 2021 to help focus gynecologic oncology discussion at the ASCO meetings. Data were retrieved using these hashtags (#goASCO20 for 2020 and #goASCO21 for 2021). A social network analysis was performed using the NodeXL software application.</p><p><strong>Results: </strong>The hashtags #goASCO20 and #goASCO21 had similar impacts on the social network. Analysis of the reach and impact of the individual hashtags found #goASCO20 to have 150 vertices and 2519 total edges and #goASCO20 to have 174 vertices and 2062 total edges. Mentions and tweets between 2020 and 2021 were also similar. The circles representing different users were spatially arranged in a more balanced way in 2021. Tweets using the #goASCO21 hashtag received significantly more responses than tweets using #goASCO20 (75 times in 2020 vs 360 times in 2021; z value=16.63 and P<.001). This indicates increased engagement in the subsequent year.</p><p><strong>Conclusions: </strong>Introducing a gynecologic oncology specialty-specific hashtag (#goASCO20 and #goASCO21) that is related but different from the official conference hashtag (#ASCO20 and #ASCO21) helped facilitate discussion on topics of interest to gynecologic oncologists during a virtual pan-oncology meeting. This impact was visible in the social network analysis.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11339558/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141989104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Influence of Model Evolution and System Roles on ChatGPT's Performance in Chinese Medical Licensing Exams: Comparative Study. 模式演变和系统角色对中国医师资格考试中 ChatGPT 成绩的影响:比较研究。
IF 3.2
JMIR Medical Education Pub Date : 2024-08-13 DOI: 10.2196/52784
Shuai Ming, Qingge Guo, Wenjun Cheng, Bo Lei
{"title":"Influence of Model Evolution and System Roles on ChatGPT's Performance in Chinese Medical Licensing Exams: Comparative Study.","authors":"Shuai Ming, Qingge Guo, Wenjun Cheng, Bo Lei","doi":"10.2196/52784","DOIUrl":"10.2196/52784","url":null,"abstract":"<p><strong>Background: </strong>With the increasing application of large language models like ChatGPT in various industries, its potential in the medical domain, especially in standardized examinations, has become a focal point of research.</p><p><strong>Objective: </strong>The aim of this study is to assess the clinical performance of ChatGPT, focusing on its accuracy and reliability in the Chinese National Medical Licensing Examination (CNMLE).</p><p><strong>Methods: </strong>The CNMLE 2022 question set, consisting of 500 single-answer multiple choices questions, were reclassified into 15 medical subspecialties. Each question was tested 8 to 12 times in Chinese on the OpenAI platform from April 24 to May 15, 2023. Three key factors were considered: the version of GPT-3.5 and 4.0, the prompt's designation of system roles tailored to medical subspecialties, and repetition for coherence. A passing accuracy threshold was established as 60%. The χ2 tests and κ values were employed to evaluate the model's accuracy and consistency.</p><p><strong>Results: </strong>GPT-4.0 achieved a passing accuracy of 72.7%, which was significantly higher than that of GPT-3.5 (54%; P<.001). The variability rate of repeated responses from GPT-4.0 was lower than that of GPT-3.5 (9% vs 19.5%; P<.001). However, both models showed relatively good response coherence, with κ values of 0.778 and 0.610, respectively. System roles numerically increased accuracy for both GPT-4.0 (0.3%-3.7%) and GPT-3.5 (1.3%-4.5%), and reduced variability by 1.7% and 1.8%, respectively (P>.05). In subgroup analysis, ChatGPT achieved comparable accuracy among different question types (P>.05). GPT-4.0 surpassed the accuracy threshold in 14 of 15 subspecialties, while GPT-3.5 did so in 7 of 15 on the first response.</p><p><strong>Conclusions: </strong>GPT-4.0 passed the CNMLE and outperformed GPT-3.5 in key areas such as accuracy, consistency, and medical subspecialty expertise. Adding a system role insignificantly enhanced the model's reliability and answer coherence. GPT-4.0 showed promising potential in medical education and clinical practice, meriting further study.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11336778/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141976840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Understanding Health Care Students' Perceptions, Beliefs, and Attitudes Toward AI-Powered Language Models: Cross-Sectional Study. 了解医学生对人工智能语言模型的看法、信念和态度:横断面研究。
IF 3.2
JMIR Medical Education Pub Date : 2024-08-13 DOI: 10.2196/51757
Ivan Cherrez-Ojeda, Juan C Gallardo-Bastidas, Karla Robles-Velasco, María F Osorio, Eleonor Maria Velez Leon, Manuel Leon Velastegui, Patrícia Pauletto, F C Aguilar-Díaz, Aldo Squassi, Susana Patricia González Eras, Erita Cordero Carrasco, Karol Leonor Chavez Gonzalez, Juan C Calderon, Jean Bousquet, Anna Bedbrook, Marco Faytong-Haro
{"title":"Understanding Health Care Students' Perceptions, Beliefs, and Attitudes Toward AI-Powered Language Models: Cross-Sectional Study.","authors":"Ivan Cherrez-Ojeda, Juan C Gallardo-Bastidas, Karla Robles-Velasco, María F Osorio, Eleonor Maria Velez Leon, Manuel Leon Velastegui, Patrícia Pauletto, F C Aguilar-Díaz, Aldo Squassi, Susana Patricia González Eras, Erita Cordero Carrasco, Karol Leonor Chavez Gonzalez, Juan C Calderon, Jean Bousquet, Anna Bedbrook, Marco Faytong-Haro","doi":"10.2196/51757","DOIUrl":"10.2196/51757","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;ChatGPT was not intended for use in health care, but it has potential benefits that depend on end-user understanding and acceptability, which is where health care students become crucial. There is still a limited amount of research in this area.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;The primary aim of our study was to assess the frequency of ChatGPT use, the perceived level of knowledge, the perceived risks associated with its use, and the ethical issues, as well as attitudes toward the use of ChatGPT in the context of education in the field of health. In addition, we aimed to examine whether there were differences across groups based on demographic variables. The second part of the study aimed to assess the association between the frequency of use, the level of perceived knowledge, the level of risk perception, and the level of perception of ethics as predictive factors for participants' attitudes toward the use of ChatGPT.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;A cross-sectional survey was conducted from May to June 2023 encompassing students of medicine, nursing, dentistry, nutrition, and laboratory science across the Americas. The study used descriptive analysis, chi-square tests, and ANOVA to assess statistical significance across different categories. The study used several ordinal logistic regression models to analyze the impact of predictive factors (frequency of use, perception of knowledge, perception of risk, and ethics perception scores) on attitude as the dependent variable. The models were adjusted for gender, institution type, major, and country. Stata was used to conduct all the analyses.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;Of 2661 health care students, 42.99% (n=1144) were unaware of ChatGPT. The median score of knowledge was \"minimal\" (median 2.00, IQR 1.00-3.00). Most respondents (median 2.61, IQR 2.11-3.11) regarded ChatGPT as neither ethical nor unethical. Most participants (median 3.89, IQR 3.44-4.34) \"somewhat agreed\" that ChatGPT (1) benefits health care settings, (2) provides trustworthy data, (3) is a helpful tool for clinical and educational medical information access, and (4) makes the work easier. In total, 70% (7/10) of people used it for homework. As the perceived knowledge of ChatGPT increased, there was a stronger tendency with regard to having a favorable attitude toward ChatGPT. Higher ethical consideration perception ratings increased the likelihood of considering ChatGPT as a source of trustworthy health care information (odds ratio [OR] 1.620, 95% CI 1.498-1.752), beneficial in medical issues (OR 1.495, 95% CI 1.452-1.539), and useful for medical literature (OR 1.494, 95% CI 1.426-1.564; P&lt;.001 for all results).&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;Over 40% of American health care students (1144/2661, 42.99%) were unaware of ChatGPT despite its extensive use in the health field. Our data revealed the positive attitudes toward ChatGPT and the desire to learn more about it. Medical educators mus","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11350293/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141971968","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Educational Utility of Clinical Vignettes Generated in Japanese by ChatGPT-4: Mixed Methods Study. 由 ChatGPT-4 生成的日语临床小故事的教育效用:混合方法研究。
IF 3.2
JMIR Medical Education Pub Date : 2024-08-13 DOI: 10.2196/59133
Hiromizu Takahashi, Kiyoshi Shikino, Takeshi Kondo, Akira Komori, Yuji Yamada, Mizue Saita, Toshio Naito
{"title":"Educational Utility of Clinical Vignettes Generated in Japanese by ChatGPT-4: Mixed Methods Study.","authors":"Hiromizu Takahashi, Kiyoshi Shikino, Takeshi Kondo, Akira Komori, Yuji Yamada, Mizue Saita, Toshio Naito","doi":"10.2196/59133","DOIUrl":"10.2196/59133","url":null,"abstract":"<p><strong>Background: </strong>Evaluating the accuracy and educational utility of artificial intelligence-generated medical cases, especially those produced by large language models such as ChatGPT-4 (developed by OpenAI), is crucial yet underexplored.</p><p><strong>Objective: </strong>This study aimed to assess the educational utility of ChatGPT-4-generated clinical vignettes and their applicability in educational settings.</p><p><strong>Methods: </strong>Using a convergent mixed methods design, a web-based survey was conducted from January 8 to 28, 2024, to evaluate 18 medical cases generated by ChatGPT-4 in Japanese. In the survey, 6 main question items were used to evaluate the quality of the generated clinical vignettes and their educational utility, which are information quality, information accuracy, educational usefulness, clinical match, terminology accuracy (TA), and diagnosis difficulty. Feedback was solicited from physicians specializing in general internal medicine or general medicine and experienced in medical education. Chi-square and Mann-Whitney U tests were performed to identify differences among cases, and linear regression was used to examine trends associated with physicians' experience. Thematic analysis of qualitative feedback was performed to identify areas for improvement and confirm the educational utility of the cases.</p><p><strong>Results: </strong>Of the 73 invited participants, 71 (97%) responded. The respondents, primarily male (64/71, 90%), spanned a broad range of practice years (from 1976 to 2017) and represented diverse hospital sizes throughout Japan. The majority deemed the information quality (mean 0.77, 95% CI 0.75-0.79) and information accuracy (mean 0.68, 95% CI 0.65-0.71) to be satisfactory, with these responses being based on binary data. The average scores assigned were 3.55 (95% CI 3.49-3.60) for educational usefulness, 3.70 (95% CI 3.65-3.75) for clinical match, 3.49 (95% CI 3.44-3.55) for TA, and 2.34 (95% CI 2.28-2.40) for diagnosis difficulty, based on a 5-point Likert scale. Statistical analysis showed significant variability in content quality and relevance across the cases (P<.001 after Bonferroni correction). Participants suggested improvements in generating physical findings, using natural language, and enhancing medical TA. The thematic analysis highlighted the need for clearer documentation, clinical information consistency, content relevance, and patient-centered case presentations.</p><p><strong>Conclusions: </strong>ChatGPT-4-generated medical cases written in Japanese possess considerable potential as resources in medical education, with recognized adequacy in quality and accuracy. Nevertheless, there is a notable need for enhancements in the precision and realism of case details. This study emphasizes ChatGPT-4's value as an adjunctive educational tool in the medical field, requiring expert oversight for optimal application.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11350316/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141971965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Resources to Support Canadian Nurses to Deliver Virtual Care: Environmental Scan. 支持加拿大护士提供虚拟护理的资源:环境扫描。
IF 3.2
JMIR Medical Education Pub Date : 2024-08-13 DOI: 10.2196/53254
Manal Kleib, Antonia Arnaert, Lynn M Nagle, Elizabeth Mirekuwaa Darko, Sobia Idrees, Daniel da Costa, Shamsa Ali
{"title":"Resources to Support Canadian Nurses to Deliver Virtual Care: Environmental Scan.","authors":"Manal Kleib, Antonia Arnaert, Lynn M Nagle, Elizabeth Mirekuwaa Darko, Sobia Idrees, Daniel da Costa, Shamsa Ali","doi":"10.2196/53254","DOIUrl":"10.2196/53254","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Regulatory and professional nursing associations have an important role in ensuring that nurses provide safe, competent, and ethical care and are capable of adapting to emerging phenomena that influence society and population health needs. Telehealth and more recently virtual care are 2 digital health modalities that have gained momentum during the COVID-19 pandemic. Telehealth refers to telecommunications and digital communication technologies used to deliver health care, support health care provider and patient education, and facilitate self-care. Virtual care facilitates the delivery of health care services via any remote communication between patients and health care providers and among health care providers, either synchronously or asynchronously, through information and communication technologies. Despite nurses' adaptability to delivering virtual care, many have also reported challenges.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;This study aims to describe resources about virtual care, digital health, and nursing informatics (ie, practice guidelines and fact sheets) available to Canadian nurses through their regulatory and professional associations.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;An environmental scan was conducted between March and July 2023. The websites of nursing regulatory bodies across 13 Canadian provinces and territories and relevant nursing and a few nonnursing professional associations were searched. Data were extracted from the websites of these organizations to map out educational materials, training opportunities, and guidelines made available for nurses to learn and adapt to the ongoing digitalization of the health care system. Information from each source was summarized and analyzed using an inductive content analysis approach to identify categories and themes. The Virtual Health Competency Framework was applied to support the analysis process.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;Seven themes were identified: (1) types of resources available about virtual care, (2) terminologies used in virtual care resources, (3) currency of virtual care resources identified, (4) requirements for providing virtual care between provinces, (5) resources through professional nursing associations and other relevant organizations, (6) regulatory guidance versus competency in virtual care, and (7) resources about digital health and nursing informatics. Results also revealed that practice guidance for delivering telehealth existed before the COVID-19 pandemic, but it was further expanded during the pandemic. Differences were noted across available resources with respect to terms used (eg, telenursing, telehealth, or virtual care), types of documents (eg, guideline vs fact sheet), and the depth of information shared. Only 2 associations provided comprehensive telenursing practice guidelines. Resources relative to digital health and nursing informatics exist, but variations between provinces were also noted.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclu","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11350304/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141971967","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Identifying Learning Preferences and Strategies in Health Data Science Courses: Systematic Review. 识别健康数据科学课程中的学习偏好和策略:系统回顾。
IF 3.2
JMIR Medical Education Pub Date : 2024-08-12 DOI: 10.2196/50667
Narjes Rohani, Stephen Sowa, Areti Manataki
{"title":"Identifying Learning Preferences and Strategies in Health Data Science Courses: Systematic Review.","authors":"Narjes Rohani, Stephen Sowa, Areti Manataki","doi":"10.2196/50667","DOIUrl":"10.2196/50667","url":null,"abstract":"<p><strong>Background: </strong>Learning and teaching interdisciplinary health data science (HDS) is highly challenging, and despite the growing interest in HDS education, little is known about the learning experiences and preferences of HDS students.</p><p><strong>Objective: </strong>We conducted a systematic review to identify learning preferences and strategies in the HDS discipline.</p><p><strong>Methods: </strong>We searched 10 bibliographic databases (PubMed, ACM Digital Library, Web of Science, Cochrane Library, Wiley Online Library, ScienceDirect, SpringerLink, EBSCOhost, ERIC, and IEEE Xplore) from the date of inception until June 2023. We followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines and included primary studies written in English that investigated the learning preferences or strategies of students in HDS-related disciplines, such as bioinformatics, at any academic level. Risk of bias was independently assessed by 2 screeners using the Mixed Methods Appraisal Tool, and we used narrative data synthesis to present the study results.</p><p><strong>Results: </strong>After abstract screening and full-text reviewing of the 849 papers retrieved from the databases, 8 (0.9%) studies, published between 2009 and 2021, were selected for narrative synthesis. The majority of these papers (7/8, 88%) investigated learning preferences, while only 1 (12%) paper studied learning strategies in HDS courses. The systematic review revealed that most HDS learners prefer visual presentations as their primary learning input. In terms of learning process and organization, they mostly tend to follow logical, linear, and sequential steps. Moreover, they focus more on abstract information, rather than detailed and concrete information. Regarding collaboration, HDS students sometimes prefer teamwork, and sometimes they prefer to work alone.</p><p><strong>Conclusions: </strong>The studies' quality, assessed using the Mixed Methods Appraisal Tool, ranged between 73% and 100%, indicating excellent quality overall. However, the number of studies in this area is small, and the results of all studies are based on self-reported data. Therefore, more research needs to be conducted to provide insight into HDS education. We provide some suggestions, such as using learning analytics and educational data mining methods, for conducting future research to address gaps in the literature. We also discuss implications for HDS educators, and we make recommendations for HDS course design; for example, we recommend including visual materials, such as diagrams and videos, and offering step-by-step instructions for students.</p>","PeriodicalId":36236,"journal":{"name":"JMIR Medical Education","volume":null,"pages":null},"PeriodicalIF":3.2,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11347898/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141971966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信