Performance of ChatGPT tool in the resolution of residency exams in Argentina

Abstract

Introduction: artificial intelligence is classified as a tool of interest at the present time. Through its application, organizational processes and decision-making are transformed; while promoting innovative development.Objective: to describe the performance of the ChatGPT tool in solving residency exams.Method: an observational, descriptive, retrospective study was carried out. As the universe of the study, all test-type questions (single selection) were analyzed. The variables analyzed were each of the questions belonging to each exam (correct or incorrect answers). Descriptive statistics were applied.Results: Syllabus B stood out within group 1 with the highest number of correct answers (209 for 69.66%). For its part, within group 2, syllabus D was predominant with 141 correct answers (70.5%). The exams related to nursing stood out.Conclusions: the use of artificial intelligence tools such as ChatGPT is variable in the field of medical sciences. Their performance in solving scientific questions is heterogeneous. It may vary with respect to the format of the question and the topic addressed.