The Banality of (Automated) Evil: Critical Reflections on the Concept of Forbidden Knowledge in Machine Learning Research

Abstract

The development of computer science has raised ethical concerns regarding the potential negative impacts of machine learning tools on people and society. Some examples are pornographic deepfakes used as weapons of war against women; pattern recognition designed to uncover sexual orientation; and misuse of data and deep learning by private companies to influence democratic elections. We contend that these three examples are cases of automated evil. In this article, we defend that the concept of forbidden knowledge can help to inform a coherent ethical framework in the context of machine learning research. We conclude that restricting generalised access to extensive data and limiting access to ready-to-use codes would mitigate potential harms caused by machine learning tools. In addition, the notions of intersectionality and interdisciplinarity should be systematically introduced in data and computer science research.