Generating Appropriate Responses to Inappropriate Robot Commands

This paper describes early work at the intersection of robot ethics and natural language generation investigating two overarching questions: (1) how might current language generation algorithms generate utterances with unintended implications or otherwise accidentally alter the ecosystem of human norms, and (2) how can we design future language systems such that they purposefully influence the human normative ecosystem as productively as possible.