Evaluating ChatGPT-4omni in paediatric developmental screening: direct versus sequential prompts.

Abstract

Integrating Large Language Models like ChatGPT-4omni (ChatGPT-4o) into paediatric healthcare could revolutionise developmental screening. This study evaluated ChatGPT-4o's efficacy in paediatric developmental screening using Direct and Sequential Prompting methods compared with the Bayley Scales of Infant Development, Third Edition. Among 106 paediatric cases, Direct Prompting showed a sensitivity of 73.42% and overall accuracy of 69.81%, while Sequential Prompting had a specificity of 62.96% and overall accuracy of 67.92%. Both methods demonstrate potential for improving the efficiency and accessibility of paediatric developmental screening, with Direct Prompts being more sensitive and Sequential Prompts more specific.