FCLLM-DT: Enpowering Federated Continual Learning With Large Language Models for Digital-Twin-Based Industrial IoT

Abstract

The Industrial Internet of Things (IIoT) represents a sophisticated technology designed to enhance production management and predict output in industrial settings, including machinery fault diagnostics. The precision of fault diagnosis is contingent upon the training efficacy of diagnostic models and their interoperability with models from other industrial facilities. Nonetheless, several critical challenges persist in maintaining these diagnostic models: 1) machinery sensors may generate abnormal data, resulting in suboptimal quality in model training; 2) sensor malfunctions may lead to interruptions in continuous data flow, thus impeding model training; and 3) collaborative interactions with other factories aiming at improving model performance may pose risks of privacy breaches. In this study, we introduce the FCLLM-DT scheme, which integrates the digital twin (DT) methodology to create a physical model of bearing for fixing abnormal sensor data. Additionally, retrieval-augmented generation (RAG)-assisted large language models (LLMs) are utilized to generate virtual datasets in instances of sensor failure. Moreover, for IIoT applications across distributed industrial environments, federated continual learning (FCL) is employed to enhance global model training by aggregating localized models from diverse facilities, thereby improving the accuracy of bearing fault diagnosis while safeguarding data privacy. The experiments on the accuracy of DT for abnormal data fix, RAG-assisted LLM for virtual data generation, and FCL for bearing fault diagnosis are conducted in comparison with three alternative methods across two datasets. The results indicate that our proposed scheme surpasses existing methods in both the enhancement of sensing data quality and the accuracy of bearing fault diagnosis.