Perceived Usefulness of Conversational Agents Predicts Search Performance in Aerospace Domain

Abstract

This paper presents a user-centered approach to the design and evaluation of conversational search user interfaces to support the pilot in cockpits. Our findings of a controlled user experiment suggest that user perception of the usefulness of the system in completing the search task and the system's responses to the relevance of the topic are good predictors of search performance. User satisfaction with the system's responses may not be a good predictor of search performance in the context of safety of life scenarios such as cockpit procedures for pilots.