Usability testing and trust analysis of a mental health and wellbeing chatbot

Abstract

Mental health chatbots are particularly useful for those who are isolated and may have difficulty attending services or for those who are reluctant to speak to a professional. In this study, the usability and trust of a chatbot known as ’ChatPal’ has been assessed. ChatPal has been developed by an interdisciplinary team encompassing health service providers, local authorities, charities and universities to promote positive mental wellbeing among individuals in rural areas across Europe. This study employed a usability test protocol to recruit representative users to complete a set of tasks using the ChatPal chatbot. Usability issues were assessed along with trust and users’ satisfaction on the System Usability Scale and the Chatbot Usability Questionnaire. The study shows the usability issues and trust with a mental health chatbot and highlights recommendations for improvement.