结合BERT和正交约束非负矩阵分解的深度名称消歧

Yangchen Huang, Licai Wang, Zhonglin Liu
{"title":"结合BERT和正交约束非负矩阵分解的深度名称消歧","authors":"Yangchen Huang, Licai Wang, Zhonglin Liu","doi":"10.1109/CCIS53392.2021.9754675","DOIUrl":null,"url":null,"abstract":"We are searching information on the Internet every day, with people’s name as the most popular entries. However, the ambiguity of name itself makes the returning page a mix of person entities with the same name or even non-person entities. Moreover, the scoring algorithm might rank well-known person which appears more frequently to the front, which would cover the information of others. Name disambiguation addresses these two issues by extracting discriminative features from the context and grouping the returning pages. Nevertheless, modern methods are limited by the complicated manual feature design and clustering methods, as well as the pre-defined cluster number by experience. In this work, we propose to learn the semantic representations of person name reference items with the pre-trained language model BERT incorporating triplet loss, and further group the learned features with a constrained non-negative matrix factorization algorithm. To select proper cluster number automatically, we employ the Silhouette Coefficient. Experiments on the benchmark datasets WePS show the superiority of our method in name disambiguation compared with other state-of-the-art methods.","PeriodicalId":191226,"journal":{"name":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","volume":"67 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Name Disambiguation by Combining BERT and Orthogonal Constrained Non-negative Matrix Factorization\",\"authors\":\"Yangchen Huang, Licai Wang, Zhonglin Liu\",\"doi\":\"10.1109/CCIS53392.2021.9754675\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We are searching information on the Internet every day, with people’s name as the most popular entries. However, the ambiguity of name itself makes the returning page a mix of person entities with the same name or even non-person entities. Moreover, the scoring algorithm might rank well-known person which appears more frequently to the front, which would cover the information of others. Name disambiguation addresses these two issues by extracting discriminative features from the context and grouping the returning pages. Nevertheless, modern methods are limited by the complicated manual feature design and clustering methods, as well as the pre-defined cluster number by experience. In this work, we propose to learn the semantic representations of person name reference items with the pre-trained language model BERT incorporating triplet loss, and further group the learned features with a constrained non-negative matrix factorization algorithm. To select proper cluster number automatically, we employ the Silhouette Coefficient. Experiments on the benchmark datasets WePS show the superiority of our method in name disambiguation compared with other state-of-the-art methods.\",\"PeriodicalId\":191226,\"journal\":{\"name\":\"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)\",\"volume\":\"67 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-11-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CCIS53392.2021.9754675\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE 7th International Conference on Cloud Computing and Intelligent Systems (CCIS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CCIS53392.2021.9754675","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

我们每天都在互联网上搜索信息,人们的名字是最受欢迎的条目。但是,名称本身的模糊性使得返回页面混合了具有相同名称的人员实体,甚至是非人员实体。此外,评分算法可能会将出现频率更高的知名人士排在前面,这将覆盖其他人的信息。名称消歧通过从上下文中提取有区别的特征并对返回的页面进行分组来解决这两个问题。然而,现代方法受到复杂的人工特征设计和聚类方法以及经验预先定义的聚类数的限制。在这项工作中,我们提出使用包含三重损失的预训练语言模型BERT学习人名参考项目的语义表示,并进一步使用约束非负矩阵分解算法对学习到的特征进行分组。为了自动选择合适的聚类数,我们采用了剪影系数。在WePS基准数据集上的实验表明,该方法在名称消歧方面优于其他先进方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep Name Disambiguation by Combining BERT and Orthogonal Constrained Non-negative Matrix Factorization
We are searching information on the Internet every day, with people’s name as the most popular entries. However, the ambiguity of name itself makes the returning page a mix of person entities with the same name or even non-person entities. Moreover, the scoring algorithm might rank well-known person which appears more frequently to the front, which would cover the information of others. Name disambiguation addresses these two issues by extracting discriminative features from the context and grouping the returning pages. Nevertheless, modern methods are limited by the complicated manual feature design and clustering methods, as well as the pre-defined cluster number by experience. In this work, we propose to learn the semantic representations of person name reference items with the pre-trained language model BERT incorporating triplet loss, and further group the learned features with a constrained non-negative matrix factorization algorithm. To select proper cluster number automatically, we employ the Silhouette Coefficient. Experiments on the benchmark datasets WePS show the superiority of our method in name disambiguation compared with other state-of-the-art methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信