Online Andrology: Real-World Status Quo of Patients' Online Information Sources and Comparison With Large Language Models in Germany.

Abstract

Background: The internet, including websites and large language models (LLMs), is an increasingly important information resource for medical patients. However, information quality varies, potentially leading to misinformation. Andrological patients may particularly rely on online sources due to the sensitive nature of their conditions.

Objectives: To assess the prevalence and quality of internet research among andrological patients and evaluate common online sources for comprehensibility, readability, and accuracy.

Materials and methods: Patients (n = 283) at four German andrological centers completed a questionnaire on their online information behavior between November 2022 and October 2023. Common online sources were objectively evaluated using the DISCERN tool and Flesch readability index in 2023. Popular LLMs were also assessed in October 2024 and compared to traditional websites.

Results: 67% (n = 190/283) of andrological patients seek medical information before appointments, primarily using the internet (52%, n = 148/283) and general practitioners (49%, n = 139/283). Patients under 50 predominantly use online sources (60%, n = 74/122). Official medical association websites and Wikipedia are preferred, but 30% also use commercial sites (n = 91/283). In general, most common websites and LLMs provide sufficient information but lack easy comprehensibility and readability.

Discussion: The study highlights the widespread use of online resources by andrological patients and emphasizes the importance of high-quality medical information. While online tools show promise, the value of physician-patient communication remains irreplaceable and cannot be replaced by chatting with LLMs.

Conclusion: Official medical association should provide accurate and easily understood information for andrological patients. Efforts to improve the online media literacy and communication skills of medical personnel are necessary.

Trial registration number: The study was registered in the German WHO primary registry, the German Clinical Trials Register (DRKS) (Number: DRKS00029651).