DDoD:对人工智能团队的双重拒绝决策攻击

IF 1.6 4区 计算机科学 Q3 COMPUTER SCIENCE, INFORMATION SYSTEMS
Benjamin Tag, Niels van Berkel, Sunny Verma, Benjamin Zi Hao Zhao, S. Berkovsky, Dali Kaafar, V. Kostakos, O. Ohrimenko
{"title":"DDoD:对人工智能团队的双重拒绝决策攻击","authors":"Benjamin Tag, Niels van Berkel, Sunny Verma, Benjamin Zi Hao Zhao, S. Berkovsky, Dali Kaafar, V. Kostakos, O. Ohrimenko","doi":"10.1109/MPRV.2022.3218773","DOIUrl":null,"url":null,"abstract":"Artificial intelligence (AI) systems have been increasingly used to make decision-making processes faster, more accurate, and more efficient. However, such systems are also at constant risk of being attacked. While the majority of attacks targeting AI-based applications aim to manipulate classifiers or training data and alter the output of an AI model, recently proposed sponge attacks against AI models aim to impede the classifier’s execution by consuming substantial resources. In this work, we propose dual denial of decision (DDoD) attacks against collaborative human-AI teams. We discuss how such attacks aim to deplete both computational and human resources, and significantly impair decision-making capabilities. We describe DDoD on human and computational resources and present potential risk scenarios in a series of exemplary domains.","PeriodicalId":55021,"journal":{"name":"IEEE Pervasive Computing","volume":"22 1","pages":"77-84"},"PeriodicalIF":1.6000,"publicationDate":"2022-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DDoD: Dual Denial of Decision Attacks on Human-AI Teams\",\"authors\":\"Benjamin Tag, Niels van Berkel, Sunny Verma, Benjamin Zi Hao Zhao, S. Berkovsky, Dali Kaafar, V. Kostakos, O. Ohrimenko\",\"doi\":\"10.1109/MPRV.2022.3218773\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Artificial intelligence (AI) systems have been increasingly used to make decision-making processes faster, more accurate, and more efficient. However, such systems are also at constant risk of being attacked. While the majority of attacks targeting AI-based applications aim to manipulate classifiers or training data and alter the output of an AI model, recently proposed sponge attacks against AI models aim to impede the classifier’s execution by consuming substantial resources. In this work, we propose dual denial of decision (DDoD) attacks against collaborative human-AI teams. We discuss how such attacks aim to deplete both computational and human resources, and significantly impair decision-making capabilities. We describe DDoD on human and computational resources and present potential risk scenarios in a series of exemplary domains.\",\"PeriodicalId\":55021,\"journal\":{\"name\":\"IEEE Pervasive Computing\",\"volume\":\"22 1\",\"pages\":\"77-84\"},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2022-12-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Pervasive Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1109/MPRV.2022.3218773\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Pervasive Computing","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1109/MPRV.2022.3218773","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

人工智能(AI)系统越来越多地用于使决策过程更快、更准确、更高效。然而,这样的系统也经常面临被攻击的风险。虽然大多数针对基于AI的应用程序的攻击旨在操纵分类器或训练数据并改变AI模型的输出,但最近提出的针对AI模型的海绵攻击旨在通过消耗大量资源来阻碍分类器的执行。在这项工作中,我们提出了针对人机协作团队的双重拒绝决策(DDoD)攻击。我们将讨论此类攻击如何消耗计算和人力资源,并严重损害决策能力。我们描述了基于人力和计算资源的DDoD,并在一系列示例领域中提出了潜在的风险场景。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
DDoD: Dual Denial of Decision Attacks on Human-AI Teams
Artificial intelligence (AI) systems have been increasingly used to make decision-making processes faster, more accurate, and more efficient. However, such systems are also at constant risk of being attacked. While the majority of attacks targeting AI-based applications aim to manipulate classifiers or training data and alter the output of an AI model, recently proposed sponge attacks against AI models aim to impede the classifier’s execution by consuming substantial resources. In this work, we propose dual denial of decision (DDoD) attacks against collaborative human-AI teams. We discuss how such attacks aim to deplete both computational and human resources, and significantly impair decision-making capabilities. We describe DDoD on human and computational resources and present potential risk scenarios in a series of exemplary domains.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Pervasive Computing
IEEE Pervasive Computing 工程技术-电信学
CiteScore
4.10
自引率
0.00%
发文量
47
审稿时长
>12 weeks
期刊介绍: IEEE Pervasive Computing explores the role of computing in the physical world–as characterized by visions such as the Internet of Things and Ubiquitous Computing. Designed for researchers, practitioners, and educators, this publication acts as a catalyst for realizing the ideas described by Mark Weiser in 1988. The essence of this vision is the creation of environments saturated with sensing, computing, and wireless communication that gracefully support the needs of individuals and society. Many key building blocks for this vision are now viable commercial technologies: wearable and handheld computers, wireless networking, location sensing, Internet of Things platforms, and so on. However, the vision continues to present deep challenges for experts in areas such as hardware design, sensor networks, mobile systems, human-computer interaction, industrial design, machine learning, data science, and societal issues including privacy and ethics. Through special issues, the magazine explores applications in areas such as assisted living, automotive systems, cognitive assistance, hardware innovations, ICT4D, manufacturing, retail, smart cities, and sustainability. In addition, the magazine accepts peer-reviewed papers of wide interest under a general call, and also features regular columns on hot topics and interviews with luminaries in the field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信