Chatbots in medicine: certification process and applied use case.

Abstract

Chatbots are computer programs designed to engage in natural language conversations in an easy and understandable way. Their use has been accelerated recently with the advent of large language models. However, their application in medicine and healthcare has been limited due to concerns over data privacy, the risk of providing medical diagnoses, and ensuring regulatory and legal compliance. Medicine and healthcare could benefit from chatbots if their scope is carefully defined and if they are used appropriately and monitored long-term. The confIAnce chatbot, developed at the Geneva University Hospitals and the University of Geneva, is an informational tool aimed at providing simplified information to the general public about primary care and chronic diseases. In this paper, we describe the certification and regulatory aspects applicable to chatbots in healthcare, particularly in primary care medicine. We use the confIAnce chatbot as a case study to explore the definition and classification of a medical device and its application to chatbots, considering the applicable Swiss regulations and the European Union AI Act. Chatbots can be classified anywhere from non-medical devices (informational tools that do not handle patient data or provide recommendations for treatment or diagnosis) to Class III medical devices (high-risk tools capable of predicting potentially fatal events and enabling a pre-emptive medical intervention). Key considerations in the definition and certification process include defining the chatbot's scope, ensuring compliance with regulations, maintaining security and safety, and continuously evaluating performance, risks, and utility. A lexicon of relevant terms related to artificial intelligence in healthcare, medical devices, and regulatory frameworks is also presented in this paper. Chatbots hold potential for both patients and healthcare professionals, provided that their scope of practice is clearly defined, and that they comply with regulatory requirements. This review aims to provide transparency by outlining the steps required for certification and regulatory compliance, making it valuable for healthcare professionals, scientists, developers, and patients.