Ryan M B Gibson, Sarah S Tomberlin, Laci O Mackay, Chad D Foradori
{"title":"生成人工智能和学生生成兽医讲义的比较。","authors":"Ryan M B Gibson, Sarah S Tomberlin, Laci O Mackay, Chad D Foradori","doi":"10.3138/jvme-2025-0003","DOIUrl":null,"url":null,"abstract":"<p><p>Generative artificial intelligence (gAI) is becoming increasingly prevalent in our daily lives. Students across multiple disciplines are using gAI for writing assessments and completing projects. This leads to the question: could gAI platforms perform similarly, worse, or better than veterinary students when asked to create discharge handouts for select veterinary neurological conditions? A total of 24 professionals and educators graded handouts based on content, clarity, client education, empathy, and professionalism for two canine neurological conditions (seizures and intervertebral disc disease). Each condition had handouts created by a high-performing student, a random/unknown student whose work was deemed to represent the average student at our institution, ChatGPT 4.0, and Google Bard. The high-performing student's handout scored higher in several categories compared with AI-generated handouts and scored statistically higher overall. Specifically, the high-performing student's seizure handout scored significantly higher in accuracy/completeness and client education than the Bard handout. Both student handouts scored significantly higher for empathy and client support than the AI tools. For the intervertebral disc disease handouts, the AI-generated handouts scored higher in clarity and organization than the random student handout, with the high-performing student's handout scoring higher in empathy and client support over the Bard-generated handout. Upon the conclusion of grading, reviewers completed a survey asking them to guess the authorship of each handout. Veterinary educators and professionals could not distinguish between gAI- and student-developed client handouts. However, the findings suggest that students have the potential to outperform current gAI technology in multiple areas, including conveying empathy.</p>","PeriodicalId":17575,"journal":{"name":"Journal of veterinary medical education","volume":" ","pages":"e20250003"},"PeriodicalIF":1.1000,"publicationDate":"2025-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Comparison of Generative Artificial Intelligence and Student-Generated Veterinary Handouts.\",\"authors\":\"Ryan M B Gibson, Sarah S Tomberlin, Laci O Mackay, Chad D Foradori\",\"doi\":\"10.3138/jvme-2025-0003\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Generative artificial intelligence (gAI) is becoming increasingly prevalent in our daily lives. Students across multiple disciplines are using gAI for writing assessments and completing projects. This leads to the question: could gAI platforms perform similarly, worse, or better than veterinary students when asked to create discharge handouts for select veterinary neurological conditions? A total of 24 professionals and educators graded handouts based on content, clarity, client education, empathy, and professionalism for two canine neurological conditions (seizures and intervertebral disc disease). Each condition had handouts created by a high-performing student, a random/unknown student whose work was deemed to represent the average student at our institution, ChatGPT 4.0, and Google Bard. The high-performing student's handout scored higher in several categories compared with AI-generated handouts and scored statistically higher overall. Specifically, the high-performing student's seizure handout scored significantly higher in accuracy/completeness and client education than the Bard handout. Both student handouts scored significantly higher for empathy and client support than the AI tools. For the intervertebral disc disease handouts, the AI-generated handouts scored higher in clarity and organization than the random student handout, with the high-performing student's handout scoring higher in empathy and client support over the Bard-generated handout. Upon the conclusion of grading, reviewers completed a survey asking them to guess the authorship of each handout. Veterinary educators and professionals could not distinguish between gAI- and student-developed client handouts. However, the findings suggest that students have the potential to outperform current gAI technology in multiple areas, including conveying empathy.</p>\",\"PeriodicalId\":17575,\"journal\":{\"name\":\"Journal of veterinary medical education\",\"volume\":\" \",\"pages\":\"e20250003\"},\"PeriodicalIF\":1.1000,\"publicationDate\":\"2025-07-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of veterinary medical education\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://doi.org/10.3138/jvme-2025-0003\",\"RegionNum\":3,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"EDUCATION, SCIENTIFIC DISCIPLINES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of veterinary medical education","FirstCategoryId":"97","ListUrlMain":"https://doi.org/10.3138/jvme-2025-0003","RegionNum":3,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
Comparison of Generative Artificial Intelligence and Student-Generated Veterinary Handouts.
Generative artificial intelligence (gAI) is becoming increasingly prevalent in our daily lives. Students across multiple disciplines are using gAI for writing assessments and completing projects. This leads to the question: could gAI platforms perform similarly, worse, or better than veterinary students when asked to create discharge handouts for select veterinary neurological conditions? A total of 24 professionals and educators graded handouts based on content, clarity, client education, empathy, and professionalism for two canine neurological conditions (seizures and intervertebral disc disease). Each condition had handouts created by a high-performing student, a random/unknown student whose work was deemed to represent the average student at our institution, ChatGPT 4.0, and Google Bard. The high-performing student's handout scored higher in several categories compared with AI-generated handouts and scored statistically higher overall. Specifically, the high-performing student's seizure handout scored significantly higher in accuracy/completeness and client education than the Bard handout. Both student handouts scored significantly higher for empathy and client support than the AI tools. For the intervertebral disc disease handouts, the AI-generated handouts scored higher in clarity and organization than the random student handout, with the high-performing student's handout scoring higher in empathy and client support over the Bard-generated handout. Upon the conclusion of grading, reviewers completed a survey asking them to guess the authorship of each handout. Veterinary educators and professionals could not distinguish between gAI- and student-developed client handouts. However, the findings suggest that students have the potential to outperform current gAI technology in multiple areas, including conveying empathy.
期刊介绍:
The Journal of Veterinary Medical Education (JVME) is the peer-reviewed scholarly journal of the Association of American Veterinary Medical Colleges (AAVMC). As an internationally distributed journal, JVME provides a forum for the exchange of ideas, research, and discoveries about veterinary medical education. This exchange benefits veterinary faculty, students, and the veterinary profession as a whole by preparing veterinarians to better perform their professional activities and to meet the needs of society.
The journal’s areas of focus include best practices and educational methods in veterinary education; recruitment, training, and mentoring of students at all levels of education, including undergraduate, graduate, veterinary technology, and continuing education; clinical instruction and assessment; institutional policy; and other challenges and issues faced by veterinary educators domestically and internationally. Veterinary faculty of all countries are encouraged to participate as contributors, reviewers, and institutional representatives.