Ethics, autonomy, and killer drones: Can machines do right?

AbstractAs technology advances, machines will increasingly serve as moral arbiters of difficult and convoluted war tasks. Humanity is already in the dawn of the “Autonomous Revolution” and ethical questions and considerations regarding the use of artificial intelligence (AI) in war cannot be delayed. The use of AI-enabled weaponized drones is a microcosm of the issues that arise. The purpose of this paper is to create and sustain a discussion of the ethics of emerging defense technologies by considering them in the context of mainstream ethical frameworks, analyzing the U.S.’s decision-making and moral justifications to date, and discussing what ethics should be instilled in AI-enabled military drones themselves, if indeed the U.S. decides to further pursue them. AcknowledgmentsThe author thanks Kerry M. Kartchner for his insight on developing the policy options for this article.Disclosure statementThe author reports there are no competing interests to declare.Notes1 Genesis 3:22 (NIV).2 Stephen Hummel and F. John Burpo, “Small Groups, Big Weapons: The Nexus of Emerging Technologies and Weapons of Mass Destruction Terrorism,” Combating Terrorism Center at West Point, April 2020, https://apps.dtic.mil/sti/pdfs/AD1100991.pdf, 12.3 Edmund F. Byrne, “Making Drones to Kill Civilians: Is It Ethical?” Journal of Business Ethics 147, no. 1 (2018): 83, http://www.jstor.org/stable/45022364.4 Byrne, “Making Drones to Kill,” 84.5 Paul McLeary and Alexander Ward, “U.S. Sending Switchblade Drones to Ukraine in $800 Million Package,” Politico, March 16, 2022, https://www.politico.com/news/2022/03/16/us-sends-switchblade-drones-to-ukraine-00017836.6 Nicola Slawson, “First Thing: Al-Qaeda Leader Killed in US Drone Strike, Joe Biden Says,” The Guardian, August 2, 2022, https://www.theguardian.com/us-news/2022/aug/02/first-thing-al-qaida-leader-killed-in-us-drone-strike-joe-biden-says.7 Sanjana Varghese, “Mass Drone Attacks in Ukraine Foreshadow the ‘Future of Warfare’,” Al Jazeera, October 20, 2022, https://www.aljazeera.com/news/2022/10/20/mass-drones-are-a-worry-for-the-future-of-warfare.8 Kris Osborn, “Navy Accelerates AI-Enabled, Autonomous Drones,” Warrior Maven, April 25, 2022, https://warriormaven.com/sea/military-drones.9 Amir Husain, “AI Is Shaping the Future of War,” PRISM 9, no. 3 (2021): 51, https://www.jstor.org/stable/48640745.10 “Artificial Intelligence (AI),” IBM, June 3, 2020, https://www.ibm.com/cloud/learn/what-is-artificial-intelligence.11 Stephan De Spiegeleire, Matthijs Maas, and Tim Sweijs, “Artificial Intelligence and the Future of Defense: Strategic Implications for Small- and Medium-Sized Force Providers,” Hague Centre for Strategic Studies, January 2017, http://www.jstor.org/stable/resrep12564.8, 53.12 De Spiegeleire, Maas, and Sweijs, “Artificial Intelligence and the Future,” 45.13 James S. Johnson, “Artificial Intelligence: A Threat to Strategic Stability,” Strategic Studies Quarterly 14, no. 1 (2020): 17–18, https://www.jstor.org/stable/26891882.14 Husain, “AI Is Shaping,” 53.15 “AlphaDogfight Trials Foreshadow Future of Human-Machine Symbiosis,” Defense Advanced Research Projects Agency (DARPA), August 26, 2020, https://www.darpa.mil/news-events/2020-08-26.16 DARPA, “AlphaDogfight Trials.”17 Natasha E. Bajema, “WMD in the Digital Age: Understanding the Impact of Emerging Technologies,” Center for the Study Weapons of Mass Destruction, October 25, 2018, https://wmdcenter.ndu.edu/Portals/97/UpdatedEnCno4.pdf?ver=2019-02-13-072413-410, 2.18 Bajema, “WMD in the Digital Age,” 17–18.19 Norine MacDonald and George Howell, “Killing Me Softly: Competition in Artificial Intelligence and Unmanned Aerial Vehicles,” PRISM 8, no. 3 (2019): 113, https://www.jstor.org/stable/26864279.20 MacDonald and Howell, “Killing Me Softly,” 114.21 John P. Caves, Jr. and W. Seth Carus, “The Future of Weapons of Mass Destruction: An Update,” National Intelligence University, February 2021, https://ni-u.edu/wp/wp-content/uploads/2021/02/Future_of_WMD_Final.pdf, 57.22 Caves and Carus, 49.23 Ash Carter, “The Moral Dimension of AI-Assisted Decision-Making: Some Practical Perspectives from the Front Lines,” Daedalus 151, no. 2 (Spring 2022): 300, https://www.jstor.org/stable/48662043.24 Carter, “The Moral Dimension,” 299.25 Husain, “AI Is Shaping,” 55.26 Dima Adamsky, The Culture of Military Innovation: The Impact of Cultural Factors on the Revolution in Military Affairs in Russia, the US, and Israel (Stanford: Stanford University Press, 2010), Kindle, location 1322.27 F.G. Hoffman, “Will War’s Nature Change in the Seventh Military Revolution?” Parameters 47, no. 4 (Winter 2017): 20, https://press.armywarcollege.edu/cgi/viewcontent.cgi?article=3101&context=parameters.28 Hoffman, “Will War’s Nature,” 31.29 Caves and Carus, “Future of Weapons,” 57.30 Don Rassler, “Remotely Piloted Innovation: Terrorism, Drones and Supportive Technology,” Combatting Terrorism Center at West Point, October 1, 2016, http://www.jstor.org/stable/resrep05632.6, 59.31 Natasha E. Bajema and Diane DiEuliis, “Peril and Promise: Emerging Technologies and WMD,” Center for the Study Weapons of Mass Destruction, May 12, 2016, https://wmdcenter.ndu.edu/Portals/97/Documents/Publications/Articles/2016%20Workshop%20Report%20FINAL%205-12-17.pdf?ver=2017-05-12-105811-853, 17–18.32 Zachary Kallenborn, “Swarms of Mass Destruction: Are Drone Swarms Weapons of Mass Destruction?” START Consortium, February 19, 2021, YouTube video, https://www.youtube.com/watch?v=yv-qvnd9-bY, 37:24.33 Zachary Kallenborn, “Swarms of Mass Destruction: The Case for Declaring Armed and Fully Autonomous Drone Swarms as WMD,” Modern War Institute at West Point, May 28, 2020, https://mwi.usma.edu/swarms-mass-destruction-case-declaring-armed-fully-autonomous-drone-swarms-wmd/.34 Kallenborn, “Swarms of Mass.”35 MacDonald and Howell, “Killing Me Softly,” 114–15.36 Michael Klare, “Pentagon Board Issues AI Guidelines,” Arms Control Today 49, no. 10 (2019): 28, https://www.jstor.org/stable/26867487.37 Thucydides, The History of the Peloponnesian War, trans. Richard Crawley (Auckland: The Floating Press, 2008), 598.38 MacDonald and Howell, “Killing Me Softly,” 120.39 GlobalData Thematic Research, “Drones in Aerospace and Defence: Macroeconomic Trends,” Army Technology, September 28, 2020, updated December 16, 2021, https://www.army-technology.com/comment/drones-aerospace-defence-trends/.40 Samuel Bendett, “How Russia Used Syria as a UAV Laboratory,” interview by Daniel Woolfolk, Defense News Weekly, February 28, 2022, 00:32, https://www.militarytimes.com/video/2022/02/28/how-russia-used-syria-as-a-uav-laboratory-actionable-intelligence/.41 “Ethics Explainer: Deontology,” The Ethics Centre, February 18, 2016, https://ethics.org.au/ethics-explainer-deontology/.42 Ethics Centre, “Ethics Explainer: Deontology.”43 New World Encyclopedia contributors, “Deontological Ethics,” New World Encyclopedia, July 27, 2022, https://www.newworldencyclopedia.org/entry/Deontological_ethics.44 Michael J. Sandel, Justice: What’s the Right Thing to Do? (New York: Farrar, Straus and Giroux, 2009), Kindle, 104.45 Ethics Centre, “Ethics Explainer: Deontology.”46 Ali Shakil, “Kantian Duty Based (Deontological) Ethics,” Seven Pillars Institute, January 29, 2013, https://sevenpillarsinstitute.org/kantian-duty-based-deontological-ethics/.47 Alexander Moseley, “Justifications of the Armed Forces,” Encyclopedia of Military Ethics, April 29, 2011, https://www.militaryethics.org/Justifications-of-the-Armed-Forces/11/.48 “Ethics Explainer: Teleology,” The Ethics Centre, April 4, 2022, https://ethics.org.au/teleology/.49 New World Encyclopedia contributors, “Teleological Ethics,” New World Encyclopedia, January 20, 2021, https://www.newworldencyclopedia.org/entry/Teleological_ethics.50 Alonzo L. Hamby, “The Decision to Use the Atomic Bomb,” Encyclopedia Britannica, no date, https://www.britannica.com/topic/Trumans-decision-to-use-the-bomb-712569/End-game.51 B. Kent Harrison, “The Decision to Drop the Bomb: Personal Observations, Studies, and Reflections,” SquareTwo 8, no. 2 (Summer 2015), https://squaretwo.org/Sq2ArticleHarrisonHiroshima.html.52 Derek Ide, “Dropping the Bomb: A Historiographical Review of the Most Destructive Decision in Human History,” Hampton Institute, June 19, 2014, https://www.hamptonthink.org/read/yp5f8wyasnfn7mncb9r3rztsbw59b7.53 Max Boot, “The ‘Torture Report’ and American Values,” Commentary, December 10, 2014, https://www.commentary.org/max-boot/the-torture-report-and-american-values/.54 Jeffrey P. Fontas, “The Bush Administration Torture Policy: Origins and Consequences,” Inquiries Journal/Student Pulse 2, no. 8 (2010), http://www.inquiriesjournal.com/a?id=276.55 Fontas, “The Bush Administration Torture.”56 Alberto Gonzales, “Decision RE Application of the Geneva Convention on Prisoners of War to the Conflict with Al Qaeda and the Taliban,” Memorandum, White House, Executive Office of the President, January 25, 2002, https://nsarchive.wrlc.org/islandora/object/torture%3A2898.57 Eyder Peralta, “’Torture Report’: A Closer Look at When and What President Bush Knew,” NPR, December 16, 2014, https://www.npr.org/sections/thetwo-way/2014/12/16/369876047/torture-report-a-closer-look-at-when-and-what-president-bush-knew.58 Amandla Thomas-Johnson, “Obama Defends Deadly Drone Campaign in New Book,” Middle East Eye, November 16, 2020, https://www.middleeasteye.net/news/obama-defends-deadly-drone-campaign-new-book.59 Julie Mertus, “The Danger of Conflating Jus Ad Bellum and Jus in Bello,” Proceedings of the Annual Meeting (American Society of International Law) 100: 116 (2006), http://www.jstor.org/stable/25660073.60 Byrne, “Making Drones to Kill,” 84.61 Shiri Krebs, “Through the Drone Looking Glass: Visualization Technologies and Military Decision-Making,” Articles of War, February 11, 2022, https://lieber.westpoint.edu/visualization-technologies-military-decision-making/.62 William Saleton, “Drones Are the Worst Form of War, Except for All the Others,” Slate, February 19, 2013, https://www.slate.com/articles/health_and_science/human_nature/2013/02/drones_war_and_civilian_casualties_how_unmanned_aircraft_reduce_collateral.html.63 Micah Zenko and Amella Mae Wolf, “Drones Kill More Civilians than Pilots Do,” Foreign Policy, April 25, 2016, https://foreignpolicy.com/2016/04/25/drones-kill-more-civilians-than-pilots-do/.64 Christian Enemark, “Drones, Risk, and Perpetual Force,” Ethics & International Affairs 28, no. 3 (2014): 369, https://doi.org/10.1017/S0892679414000446.65 Jovana Davidovic, “Should the Changing Character of War Affect Our Theories of War?” Ethical Theory and Moral Practice 19, no. 3 (2016): 609–10, http://www.jstor.org/stable/24762489.66 Enemark, “Drones, Risk, and Perpetual,” 374.67 Donald Stoker and Craig Whiteside, “Blurred Lines: Gray-Zone Conflict and Hybrid War—Two Failures of American Strategic Thinking,” Naval War College Review 73, no. 1 (2020): 17, https://www.jstor.org/stable/26868211.68 Maria Stefania Cataleta, “Humane Artificial Intelligence: The Fragility of Human Rights Facing AI,” East-West Center, January 2020, http://www.jstor.org/stable/resrep25514, 28.69 Edmond Awad, et al., “The Moral Machine Experiment,” Nature 563 (2018): 59, https://doi.org/10.1038/s41586-018-0637-6.70 Awad et al., “Moral Machine Experiment,” 63.71 “DOD Adopts Ethical Principles for Artificial Intelligence,” Department of Defense, February 24, 2020, https://www.defense.gov/News/Releases/Release/Article/2091996/dod-adopts-ethical-principles-for-artificial-intelligence/.72 Department of Defense, “DOD Adopts Ethical.”73 Ibid.74 Ibid.75 Will Douglas Heaven, “The Department of Defense Is Issuing AI Ethics Guidelines for Tech Contractors,” MIT Technology Review, November 16, 2021, https://www.technologyreview.com/2021/11/16/1040190/department-of-defense-government-ai-ethics-military-project-maven/.76 “Responsible AI Guidelines,” Defense Innovation Unit, n.d., https://www.diu.mil/responsible-ai-guidelines#planning.77 Defense Innovation Unit, “Responsible AI Guidelines.”78 Ibid.79 Krebs, “Through the Drone.”80 James Johnson, “Automating the OODA Loop in the Age of Intelligent Machines: Reaffirming the Role of Humans in Command-and-Control Decision-Making in the Digital Age,” Defence Studies (July 2022), DOI: 10.1080/14702436.2022.2102486.81 Husain, “AI Is Shaping,” 60–1.82 Paul Scharre, “Robotics on the Battlefield Part II: The Coming Swarm,” Center for a New American Security, October 15, 2014, https://www.cnas.org/publications/reports/robotics-on-the-battlefield-part-ii-the-coming-swarm.Additional informationNotes on contributorsAndrew BrownAndrew Brown (ab9938s@missouristate.edu) is a Defense and Strategic Studies–Countering Weapons of Mass Destruction graduate student at Missouri State University. He is interested in Middle Eastern security challenges and the nexus of emerging technologies and national defense.