Refining the process picture: Unstructured data in object-centric process mining

Process mining aims to discover, monitor, and improve processes. To this end, process mining techniques use event data, typically extracted from information systems and organized along process instances. The inherent complexity of real-world processes has driven the recent introduction of object-centric process mining, allowing for a more comprehensive view of processes. Another avenue of research contributing to more complete process analyses is integrating unstructured data, which can enhance traditional event logs by extracting hitherto unidentified process information. Although combining the object-centric perspective with event log enrichment from unstructured data sources holds promising potential, such investigation remains in its infancy. Against this background, this study presents the OCRAUD, a reference architecture that provides guidance on using unstructured data sources and traditional event logs for object-centric process mining. A design science research process was employed to design and evaluate the OCRAUD. This involved conducting a total of 20 expert interviews over two rounds, comparing the OCRAUD to competing artifacts, instantiating the artifact for the use of video and sensor data, developing a software prototype, and applying the prototype to real-world data. This work contributes to process mining by guiding the combination of unstructured data with traditional event logs, incorporating an object-centric representation of event data. The instantiation targets video and sensor data, thereby demonstrating the use of the artifact. This enables researchers and practitioners to instantiate the artifact for other data types or specific use cases. The published code of the software prototype allows for further development of the implemented algorithms.