Unleashing the potential of AI: a deeper dive into GPT prompts for medical research.

Abstract

© Author(s) (or their employer(s)) 2023. Reuse permitted under CC BYNC. No commercial reuse. See rights and permissions. Published by BMJ. I read the article by Haemmerli et al on the performance of ChatGPT3.5 in generating treatment recommendations for central nervous system (CNS) tumours, which were then evaluated by tumour board (TB) experts. While the study did illuminate promising aspects of the Artificial Intelligence (AI) model, the design of the prompt used to interact with ChatGPT warrants further consideration. In the study, the prompt employed was a brief patient history, followed by two questions, which appears to have limited the model’s performance. As a sophisticated large language model (LLM), GPT3.5 relies heavily on the context and specificity of the provided prompt. 2 Based on cited literature, an alternative prompt structure could have included context, specific intent, a question and an expected response format. Moreover, pretraining the LLM with examples of the expected answer significantly improves the quality of the answer. 3 Finally, the introduction of GPT4 in early March 2023 has shown considerable improvement in understanding and generating responses when compared with ChatGPT3.5. 5