Noor Al-Ansari, Dena Al-Thani, Reem S. Al-Mansoori
{"title":"以用户为中心的可解释人工智能(XAI)评估:系统性文献综述","authors":"Noor Al-Ansari, Dena Al-Thani, Reem S. Al-Mansoori","doi":"10.1155/2024/4628855","DOIUrl":null,"url":null,"abstract":"<p>Researchers have developed a variety of approaches to evaluate explainable artificial intelligence (XAI) systems using human–computer interaction (HCI) user-centered techniques. This systematic literature review has been conducted to understand how these approaches are used to achieve XAI goals. The aim of this review is to explore the methods used to evaluate XAI systems in studies involving human subjects. A total of 101 full-text studies were systematically selected and analyzed from a sample of 3414 studies obtained from four renowned databases between 2018 and 2023. The analysis focuses on prominent XAI goals achieved across 10 domains and the machine learning (ML) models utilized to create these XAI systems. The analysis also explores explanation methods and detailed study methodologies used by researchers in previous work. The analysis is concluded by categorizing the challenges experienced by researchers into three types. Exploring the methodologies employed by researchers, the review discusses the benefits and shortcomings of the data collection methods and participant recruitment. In conclusion, this review offers a framework that consists of six pillars that researchers can follow for evaluating user-centered studies in the field of XAI.</p>","PeriodicalId":36408,"journal":{"name":"Human Behavior and Emerging Technologies","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1155/2024/4628855","citationCount":"0","resultStr":"{\"title\":\"User-Centered Evaluation of Explainable Artificial Intelligence (XAI): A Systematic Literature Review\",\"authors\":\"Noor Al-Ansari, Dena Al-Thani, Reem S. Al-Mansoori\",\"doi\":\"10.1155/2024/4628855\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Researchers have developed a variety of approaches to evaluate explainable artificial intelligence (XAI) systems using human–computer interaction (HCI) user-centered techniques. This systematic literature review has been conducted to understand how these approaches are used to achieve XAI goals. The aim of this review is to explore the methods used to evaluate XAI systems in studies involving human subjects. A total of 101 full-text studies were systematically selected and analyzed from a sample of 3414 studies obtained from four renowned databases between 2018 and 2023. The analysis focuses on prominent XAI goals achieved across 10 domains and the machine learning (ML) models utilized to create these XAI systems. The analysis also explores explanation methods and detailed study methodologies used by researchers in previous work. The analysis is concluded by categorizing the challenges experienced by researchers into three types. Exploring the methodologies employed by researchers, the review discusses the benefits and shortcomings of the data collection methods and participant recruitment. In conclusion, this review offers a framework that consists of six pillars that researchers can follow for evaluating user-centered studies in the field of XAI.</p>\",\"PeriodicalId\":36408,\"journal\":{\"name\":\"Human Behavior and Emerging Technologies\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-07-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1155/2024/4628855\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Human Behavior and Emerging Technologies\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1155/2024/4628855\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Human Behavior and Emerging Technologies","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1155/2024/4628855","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
User-Centered Evaluation of Explainable Artificial Intelligence (XAI): A Systematic Literature Review
Researchers have developed a variety of approaches to evaluate explainable artificial intelligence (XAI) systems using human–computer interaction (HCI) user-centered techniques. This systematic literature review has been conducted to understand how these approaches are used to achieve XAI goals. The aim of this review is to explore the methods used to evaluate XAI systems in studies involving human subjects. A total of 101 full-text studies were systematically selected and analyzed from a sample of 3414 studies obtained from four renowned databases between 2018 and 2023. The analysis focuses on prominent XAI goals achieved across 10 domains and the machine learning (ML) models utilized to create these XAI systems. The analysis also explores explanation methods and detailed study methodologies used by researchers in previous work. The analysis is concluded by categorizing the challenges experienced by researchers into three types. Exploring the methodologies employed by researchers, the review discusses the benefits and shortcomings of the data collection methods and participant recruitment. In conclusion, this review offers a framework that consists of six pillars that researchers can follow for evaluating user-centered studies in the field of XAI.
期刊介绍:
Human Behavior and Emerging Technologies is an interdisciplinary journal dedicated to publishing high-impact research that enhances understanding of the complex interactions between diverse human behavior and emerging digital technologies.