面向工业时间序列预测的两阶段隐私保护域自适应

IF 5.3 3区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Zidi Jia;Lei Ren;Haiteng Wang;Yuanjun Laili
{"title":"面向工业时间序列预测的两阶段隐私保护域自适应","authors":"Zidi Jia;Lei Ren;Haiteng Wang;Yuanjun Laili","doi":"10.1109/TETCI.2024.3502418","DOIUrl":null,"url":null,"abstract":"Domain adaptation (DA), as an emerging computational intelligence technology, is crucial for industrial time-series prediction, since various operating environments and tasks of industrial equipment will lead to variants in the distribution of monitoring data. Recently, many DA methods have been proposed to adapt to cross-domain industrial scenarios with data distribution shifting. However, due to privacy preserving concerns, data owners are reluctant to share their data, resulting in inaccessible source data. The artificial intelligence (AI) model trained by the inaccessible source data can be only applied as a blackbox. This makes it difficult to transfer source domain knowledge to the target domain. To solve this issue, we propose a two-stage source-free domain adaptation method for unsupervised knowledge transfer for industrial time-series prediction. At the first stage, an adversarial training method is proposed to improve the model's ability to represent data in the target domain, which may significantly differ from the source distribution. At the second stage, an unsupervised feature alignment method based on mean-teacher is proposed to align the target domain data with source knowledge. Additionally, we defined two contrastive loss functions to strengthen the consistent representation of target data. Experiments conducted on datasets N-CMAPSS and FEMOTO-ST demonstrate the effectiveness of the proposed method.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":"9 4","pages":"2846-2857"},"PeriodicalIF":5.3000,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Two-Stage Privacy-Preserving Domain Adaptation for Industrial Time-Series Prediction\",\"authors\":\"Zidi Jia;Lei Ren;Haiteng Wang;Yuanjun Laili\",\"doi\":\"10.1109/TETCI.2024.3502418\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Domain adaptation (DA), as an emerging computational intelligence technology, is crucial for industrial time-series prediction, since various operating environments and tasks of industrial equipment will lead to variants in the distribution of monitoring data. Recently, many DA methods have been proposed to adapt to cross-domain industrial scenarios with data distribution shifting. However, due to privacy preserving concerns, data owners are reluctant to share their data, resulting in inaccessible source data. The artificial intelligence (AI) model trained by the inaccessible source data can be only applied as a blackbox. This makes it difficult to transfer source domain knowledge to the target domain. To solve this issue, we propose a two-stage source-free domain adaptation method for unsupervised knowledge transfer for industrial time-series prediction. At the first stage, an adversarial training method is proposed to improve the model's ability to represent data in the target domain, which may significantly differ from the source distribution. At the second stage, an unsupervised feature alignment method based on mean-teacher is proposed to align the target domain data with source knowledge. Additionally, we defined two contrastive loss functions to strengthen the consistent representation of target data. Experiments conducted on datasets N-CMAPSS and FEMOTO-ST demonstrate the effectiveness of the proposed method.\",\"PeriodicalId\":13135,\"journal\":{\"name\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"volume\":\"9 4\",\"pages\":\"2846-2857\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-11-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Emerging Topics in Computational Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10771794/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Emerging Topics in Computational Intelligence","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10771794/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

领域自适应(DA)作为一种新兴的计算智能技术,对于工业时间序列预测至关重要,因为工业设备的不同运行环境和任务会导致监测数据分布的变化。近年来,为了适应数据分布变化的跨域工业场景,提出了许多数据分析方法。然而,出于隐私保护的考虑,数据所有者不愿意共享他们的数据,导致源数据无法访问。由不可访问的源数据训练出来的人工智能模型只能作为一个黑箱来应用。这使得很难将源领域知识转移到目标领域。为了解决这一问题,提出了一种两阶段无源域自适应的工业时间序列预测无监督知识转移方法。在第一阶段,提出了一种对抗训练方法,以提高模型在目标域中表示数据的能力,目标域中的数据可能与源分布存在显著差异。第二阶段,提出了一种基于均值教师的无监督特征对齐方法,将目标领域数据与源知识对齐。此外,我们定义了两个对比损失函数,以加强目标数据的一致性表示。在N-CMAPSS和FEMOTO-ST数据集上进行的实验验证了该方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Two-Stage Privacy-Preserving Domain Adaptation for Industrial Time-Series Prediction
Domain adaptation (DA), as an emerging computational intelligence technology, is crucial for industrial time-series prediction, since various operating environments and tasks of industrial equipment will lead to variants in the distribution of monitoring data. Recently, many DA methods have been proposed to adapt to cross-domain industrial scenarios with data distribution shifting. However, due to privacy preserving concerns, data owners are reluctant to share their data, resulting in inaccessible source data. The artificial intelligence (AI) model trained by the inaccessible source data can be only applied as a blackbox. This makes it difficult to transfer source domain knowledge to the target domain. To solve this issue, we propose a two-stage source-free domain adaptation method for unsupervised knowledge transfer for industrial time-series prediction. At the first stage, an adversarial training method is proposed to improve the model's ability to represent data in the target domain, which may significantly differ from the source distribution. At the second stage, an unsupervised feature alignment method based on mean-teacher is proposed to align the target domain data with source knowledge. Additionally, we defined two contrastive loss functions to strengthen the consistent representation of target data. Experiments conducted on datasets N-CMAPSS and FEMOTO-ST demonstrate the effectiveness of the proposed method.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
10.30
自引率
7.50%
发文量
147
期刊介绍: The IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI) publishes original articles on emerging aspects of computational intelligence, including theory, applications, and surveys. TETCI is an electronics only publication. TETCI publishes six issues per year. Authors are encouraged to submit manuscripts in any emerging topic in computational intelligence, especially nature-inspired computing topics not covered by other IEEE Computational Intelligence Society journals. A few such illustrative examples are glial cell networks, computational neuroscience, Brain Computer Interface, ambient intelligence, non-fuzzy computing with words, artificial life, cultural learning, artificial endocrine networks, social reasoning, artificial hormone networks, computational intelligence for the IoT and Smart-X technologies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信