Implementation of mixed reality for data visualization in liquid soap filling processes

Abstract

Visualizing data in industrial processes represents a critical component of Industry 4.0, offering opportunities for better decision-making, real-time monitoring, and process optimization. This article presents an architecture design that enables data capture from control technologies and integrates into a Mixed Reality (MR) system for data visualization in the context of liquid soap filling processes. The system integrates real-time process data from a programmable logic controller (PLC) into MR technology, thereby creating an immersive platform that serves to enhance understanding and interaction with operational metrics. This was structured into five distinct phases. Initially, an analysis of the filling line was performed to determine the data sources and user requirements. Subsequently, immersive technologies that would facilitate hands-free interaction, spatial mapping, and integration of digital data with the physical environment were evaluated. The third phase entailed the implementation of the PLC-MR data integration via a custom API. The fourth phase involved iterative refinements, informed by hands-on feedback from prototype trials. Finally, a usability evaluation was conducted to ensure the effectiveness and user-friendliness of the developed solution. A validation with seventeen operators of the industrial filling system confirmed that the system provides a clear and intuitive view of the filling process. When the interaction time of the proposed platform was evaluated, it was found that it was improved compared to the traditional method of visualization through the HMI. This position the interface as a viable reference for future industrial MR applications. The results of this study underscore the potential of MR as a transformative tool for industrial data visualization.