Liangzhu Zhou, Xingrui Zhuo, Gongqing Wu, Zan Zhang, Xianyu Bao
{"title":"Research on Crowdsourcing Truth Inference Method Based on Graph Embedding","authors":"Liangzhu Zhou, Xingrui Zhuo, Gongqing Wu, Zan Zhang, Xianyu Bao","doi":"10.1109/ICKG52313.2021.00036","DOIUrl":null,"url":null,"abstract":"Crowdsourcing is a cheap and popular method to solve problems that are difficult for computers to handle. Due to the differences in ability among workers on crowdsourcing platforms, existing research use aggregation strategies to deal with the labels of different workers to improve the utility of crowdsourcing data. However, most of these studies are based on probabilistic graphical models, which have problems such as difficulty in setting initial parameters. This paper proposes a novel crowdsourcing method Truth Inference based on Graph Embedding (TIGE) for single-choice questions, the method draws on the idea of graph autoencoder, constructs feature vectors for each crowdsourcing task, embeds the relationship between crowdsourcing tasks and workers in graphs, then uses graph neural networks to convert crowdsourcing problems into graph node prediction problems. The feature vectors are continuously optimized in the convolutional layer to obtain the final result. Compared with the six state-of-the-art algorithms on real-world datasets, our method has significant advantages in accuracy and F1-score.","PeriodicalId":174126,"journal":{"name":"2021 IEEE International Conference on Big Knowledge (ICBK)","volume":"239 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Big Knowledge (ICBK)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICKG52313.2021.00036","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Crowdsourcing is a cheap and popular method to solve problems that are difficult for computers to handle. Due to the differences in ability among workers on crowdsourcing platforms, existing research use aggregation strategies to deal with the labels of different workers to improve the utility of crowdsourcing data. However, most of these studies are based on probabilistic graphical models, which have problems such as difficulty in setting initial parameters. This paper proposes a novel crowdsourcing method Truth Inference based on Graph Embedding (TIGE) for single-choice questions, the method draws on the idea of graph autoencoder, constructs feature vectors for each crowdsourcing task, embeds the relationship between crowdsourcing tasks and workers in graphs, then uses graph neural networks to convert crowdsourcing problems into graph node prediction problems. The feature vectors are continuously optimized in the convolutional layer to obtain the final result. Compared with the six state-of-the-art algorithms on real-world datasets, our method has significant advantages in accuracy and F1-score.