一种基于模糊边缘密度的概念漂移检测算法

Jing Yang, Jie Zhang, Sujuan Qin
{"title":"一种基于模糊边缘密度的概念漂移检测算法","authors":"Jing Yang, Jie Zhang, Sujuan Qin","doi":"10.1145/3395260.3395301","DOIUrl":null,"url":null,"abstract":"With the continuous emergence of data, concept drift in data streams is becoming more and more common. In the past, concept drift detection was regarded as a task based on supervised learning, but it is of practical significance to study concept drift in semi-supervised or unsupervised learning since it is difficult to get all the labels of the data streams in real time. Existing algorithms based on semi-supervised learning to detect concept drift show good performance, but there is still room for improvement in terms of detection delay and false alarm rate. In this paper, we propose an algorithm named as Fuzzy Margin Density Drift Detection suitable for semi-supervised learning. This method explores the membership function of the fuzzy marginal dataset to more accurately describe and quantify the classification confidence of samples in the data stream, which takes full advantage of the classification confidence of each samples. This method is more accurate for concept drift detection, and can avoid the false alarm in some degree. We verified the effectiveness of the proposed algorithm through experiments on synthetic and real data set.","PeriodicalId":103490,"journal":{"name":"Proceedings of the 2020 5th International Conference on Mathematics and Artificial Intelligence","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Concept Drift Detection Algorithm based on Fuzzy Marginal Density\",\"authors\":\"Jing Yang, Jie Zhang, Sujuan Qin\",\"doi\":\"10.1145/3395260.3395301\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the continuous emergence of data, concept drift in data streams is becoming more and more common. In the past, concept drift detection was regarded as a task based on supervised learning, but it is of practical significance to study concept drift in semi-supervised or unsupervised learning since it is difficult to get all the labels of the data streams in real time. Existing algorithms based on semi-supervised learning to detect concept drift show good performance, but there is still room for improvement in terms of detection delay and false alarm rate. In this paper, we propose an algorithm named as Fuzzy Margin Density Drift Detection suitable for semi-supervised learning. This method explores the membership function of the fuzzy marginal dataset to more accurately describe and quantify the classification confidence of samples in the data stream, which takes full advantage of the classification confidence of each samples. This method is more accurate for concept drift detection, and can avoid the false alarm in some degree. We verified the effectiveness of the proposed algorithm through experiments on synthetic and real data set.\",\"PeriodicalId\":103490,\"journal\":{\"name\":\"Proceedings of the 2020 5th International Conference on Mathematics and Artificial Intelligence\",\"volume\":\"4 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-04-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2020 5th International Conference on Mathematics and Artificial Intelligence\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3395260.3395301\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2020 5th International Conference on Mathematics and Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3395260.3395301","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

随着数据的不断涌现,数据流中的概念漂移现象越来越普遍。过去,概念漂移检测被认为是一种基于监督学习的任务,但由于难以实时获取数据流的所有标签,因此在半监督或无监督学习中对概念漂移进行研究具有重要的现实意义。现有的基于半监督学习的概念漂移检测算法表现出较好的性能,但在检测延迟和虚警率方面仍有改进的空间。本文提出了一种适用于半监督学习的模糊边界密度漂移检测算法。该方法通过探索模糊边缘数据集的隶属函数,更准确地描述和量化数据流中样本的分类置信度,充分利用了每个样本的分类置信度。该方法对概念漂移检测精度更高,并能在一定程度上避免误报。通过在合成数据集和真实数据集上的实验,验证了该算法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Concept Drift Detection Algorithm based on Fuzzy Marginal Density
With the continuous emergence of data, concept drift in data streams is becoming more and more common. In the past, concept drift detection was regarded as a task based on supervised learning, but it is of practical significance to study concept drift in semi-supervised or unsupervised learning since it is difficult to get all the labels of the data streams in real time. Existing algorithms based on semi-supervised learning to detect concept drift show good performance, but there is still room for improvement in terms of detection delay and false alarm rate. In this paper, we propose an algorithm named as Fuzzy Margin Density Drift Detection suitable for semi-supervised learning. This method explores the membership function of the fuzzy marginal dataset to more accurately describe and quantify the classification confidence of samples in the data stream, which takes full advantage of the classification confidence of each samples. This method is more accurate for concept drift detection, and can avoid the false alarm in some degree. We verified the effectiveness of the proposed algorithm through experiments on synthetic and real data set.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信