Evaluation of Information About Cardiovascular Implications of Gender-Affirming Care From Online Chat-based Artificial Intelligence Systems

Abstract

Because of restrictive laws in multiple states for gender-affirming care, patients might be prompted to get recommendations from contemporary online chatbots. This study explored the appropriateness of such recommendations using validated tools to assess patient education materials by a team of LGBTQ-affirming cardiologists. The study showed that although all systems emphasize the need for multidisciplinary care, there were notable differences in the comprehensiveness, cultural appropriateness, and presentation of their responses. GPT-4 (https://chatbotapp.ai) and Gemini (https://gemini.google.com/app) outperformed Bing (https://copilot.microsoft.com), particularly in the balanced and culturally sensitive delivery of information.