{"title":"Augmenting post-hoc explanations for predictive process monitoring with uncertainty quantification via conformalized Monte Carlo dropout","authors":"Nijat Mehdiyev, Maxim Majlatow, Peter Fettke","doi":"10.1016/j.datak.2024.102402","DOIUrl":null,"url":null,"abstract":"<div><div>This study presents a novel approach to improve the transparency and reliability of deep learning models in predictive process monitoring (PPM) by integrating uncertainty quantification (UQ) and explainable artificial intelligence (XAI) techniques. We introduce the conformalized Monte Carlo dropout method, which combines Monte Carlo dropout for uncertainty estimation with conformal prediction (CP) to generate reliable prediction intervals. Additionally, we enhance post-hoc explanation techniques such as individual conditional expectation (ICE) plots and partial dependence plots (PDP) with uncertainty information, including credible and conformal predictive intervals. Our empirical evaluation in the manufacturing industry demonstrates the effectiveness of these approaches in refining strategic and operational decisions. This research contributes to advancing PPM and machine learning by bridging the gap between model transparency and high-stakes decision-making scenarios.</div></div>","PeriodicalId":55184,"journal":{"name":"Data & Knowledge Engineering","volume":"156 ","pages":"Article 102402"},"PeriodicalIF":2.7000,"publicationDate":"2024-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Data & Knowledge Engineering","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0169023X24001265","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
This study presents a novel approach to improve the transparency and reliability of deep learning models in predictive process monitoring (PPM) by integrating uncertainty quantification (UQ) and explainable artificial intelligence (XAI) techniques. We introduce the conformalized Monte Carlo dropout method, which combines Monte Carlo dropout for uncertainty estimation with conformal prediction (CP) to generate reliable prediction intervals. Additionally, we enhance post-hoc explanation techniques such as individual conditional expectation (ICE) plots and partial dependence plots (PDP) with uncertainty information, including credible and conformal predictive intervals. Our empirical evaluation in the manufacturing industry demonstrates the effectiveness of these approaches in refining strategic and operational decisions. This research contributes to advancing PPM and machine learning by bridging the gap between model transparency and high-stakes decision-making scenarios.
期刊介绍:
Data & Knowledge Engineering (DKE) stimulates the exchange of ideas and interaction between these two related fields of interest. DKE reaches a world-wide audience of researchers, designers, managers and users. The major aim of the journal is to identify, investigate and analyze the underlying principles in the design and effective use of these systems.