Robodebt cultures and useful idiots: Why Robodebt was not a techno-failure

Abstract

Australia's Robodebt scheme is now internationally infamous for how not to use automation in government. Belying heightened concern with artificial intelligence, Robodebt involved traditional, relatively simple computer algorithms to automate the identification and pursuit of alleged historical welfare debts. Yet, it was based on a false legal premise. This paper argues that rather than a technical failure, Robodebt was intentional, motivated by political imperatives, aided and abetted by an overly responsive public service culture. Engaging with the literature of organisational wilful ignorance, it is argued that these political and public service cultures were constituted by useful idiots, who acted as foils to keep the illegal scheme running for 4 years. Drawing on the Report of the Royal Commission into the Robodebt Scheme, the paper identifies a range of practices through which strategic wilful ignorance of Robodebt's unlawfulness was actively constituted. Such practices, particularly well-versed in the senior echolons of the public service, include feigning ignorance, studious nonresponse and not asking questions, telling untruths and giving ambiguous information, advising informally, not sharing and withholding information, and individual and institutional bullying. Documenting the concrete mechanisms of wilful organisational ignorance contributes to better understanding of this phenomenon and helps remedial action.