The new frontier of platform policy

Abstract

Platform policies aimed at the misbehaviour of users that occurs off of the platform, especially offline abuse, are a relatively new and understudied phenomenon that may represent a new frontier of platform policy. Policies of this nature may be necessary to create healthy online communities, but they raise unique problems in comparison to on-platform content moderation that exacerbate existing concerns about the accountability and transparency of platforms. This article provides the background and context for the development of such policies through the case study of Twitch.tv. It then discusses three unique challenges raised by the creation and enforcement of policies aimed at off-platform abuse. These are 1) the need for investigation and verifying evidence, 2) the difficulty of balancing the privacy of all parties with a fair process, and 3) the increased potential adverse impacts of error. It argues that current policies are opaque and offer few guarantees to either complainants or the targets of complaints. Further steps, especially greater transparency and broader consultation, must be taken to ensure accountability to users and the public when such policies are implemented. It concludes by discussing the possibility that similar policies will be adopted by other platforms and calls for greater public and academic discussion of where, when, and how such policies should be implemented.