Debate: Conversational AI and young people's mental health – friend or foe? – the illusion of a safe space for youth mental health

Abstract

Artificially intelligent (AI) chatbots are increasingly used for mental health support, yet their safety guidelines and ethical structures remain unclear, particularly for youth populations. We put forward that many AI-based mental health chatbots create the illusion of a safe and accessible therapeutic space. Drawing on observations from 117 publicly available applications, we contend that claims of full accessibility and confidentiality are countered by both explicit and at times implicit requirements to fully engage with the chatbot, including entering personal information, agreeing to extensive data sharing, and making payments. Applications often overstate the professional expertise and therapeutic outcomes delivered, potentially misleading users to overestimate application capabilities. With the growing popularity of AI chatbots among youth, it is essential to raise awareness about how they create the illusion of a safe space and empower users to make safe and informed decisions about their use.