一种改进的记录聚类和链接中僧伽罗语词名匹配方法

G. Hettiarachchi, D. Attygalle
{"title":"一种改进的记录聚类和链接中僧伽罗语词名匹配方法","authors":"G. Hettiarachchi, D. Attygalle","doi":"10.1109/GHTC.2012.60","DOIUrl":null,"url":null,"abstract":"Quality of data residing in a database gets degraded and leads to misinterpretation due to a multitude of factors. Such factors vary from poor database design, lack of standards for recording database fields to typing mistakes (lexicographical errors, character transpositions). In such a case it is important to identify duplicates and merge them into a single entity. In doing so, one problem that arises is, the way in which string attributes are to be compared. Even though there are different methods in the literature that address the issue of approximate string matching, they all fall short in terms of accuracy when encountered with words from the Sinhalese language written in English. In this paper, it is intended to propose the development of an improved phonetic matching algorithm which improved the accuracy of approximate string matching remarkably. This modified algorithm outperforms the phonetic matching algorithms available in the literature, when applied on datasets containing Sinhalese names and words written in English. In addition, it demonstrates a computational time comparable with phonetic matching algorithms available in the literature. Thus, the modified algorithm which we name “SPARCL” outperforms other phonetic matching algorithms and is illustrated with a real life application.","PeriodicalId":265555,"journal":{"name":"2012 IEEE Global Humanitarian Technology Conference","volume":"97 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2012-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"11","resultStr":"{\"title\":\"SPARCL: An Improved Approach for Matching Sinhalese Words and Names in Record Clustering and Linkage\",\"authors\":\"G. Hettiarachchi, D. Attygalle\",\"doi\":\"10.1109/GHTC.2012.60\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Quality of data residing in a database gets degraded and leads to misinterpretation due to a multitude of factors. Such factors vary from poor database design, lack of standards for recording database fields to typing mistakes (lexicographical errors, character transpositions). In such a case it is important to identify duplicates and merge them into a single entity. In doing so, one problem that arises is, the way in which string attributes are to be compared. Even though there are different methods in the literature that address the issue of approximate string matching, they all fall short in terms of accuracy when encountered with words from the Sinhalese language written in English. In this paper, it is intended to propose the development of an improved phonetic matching algorithm which improved the accuracy of approximate string matching remarkably. This modified algorithm outperforms the phonetic matching algorithms available in the literature, when applied on datasets containing Sinhalese names and words written in English. In addition, it demonstrates a computational time comparable with phonetic matching algorithms available in the literature. Thus, the modified algorithm which we name “SPARCL” outperforms other phonetic matching algorithms and is illustrated with a real life application.\",\"PeriodicalId\":265555,\"journal\":{\"name\":\"2012 IEEE Global Humanitarian Technology Conference\",\"volume\":\"97 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2012-10-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"11\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2012 IEEE Global Humanitarian Technology Conference\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/GHTC.2012.60\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2012 IEEE Global Humanitarian Technology Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/GHTC.2012.60","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 11

摘要

驻留在数据库中的数据质量会下降,并由于多种因素导致误解。这些因素多种多样,从糟糕的数据库设计、缺乏记录数据库字段的标准到打字错误(词典编纂错误、字符换位)。在这种情况下,重要的是识别重复并将它们合并到单个实体中。在这样做的过程中,出现了一个问题,即字符串属性的比较方式。尽管文献中有不同的方法来解决近似字符串匹配的问题,但当遇到用英语书写的僧伽罗语单词时,它们的准确性都很低。本文提出了一种改进的语音匹配算法,该算法显著提高了近似字符串匹配的精度。当应用于包含僧伽罗语名称和英语单词的数据集时,这种改进的算法优于文献中可用的语音匹配算法。此外,它还证明了与文献中可用的语音匹配算法相当的计算时间。因此,我们称之为“SPARCL”的改进算法优于其他语音匹配算法,并通过实际应用进行了说明。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
SPARCL: An Improved Approach for Matching Sinhalese Words and Names in Record Clustering and Linkage
Quality of data residing in a database gets degraded and leads to misinterpretation due to a multitude of factors. Such factors vary from poor database design, lack of standards for recording database fields to typing mistakes (lexicographical errors, character transpositions). In such a case it is important to identify duplicates and merge them into a single entity. In doing so, one problem that arises is, the way in which string attributes are to be compared. Even though there are different methods in the literature that address the issue of approximate string matching, they all fall short in terms of accuracy when encountered with words from the Sinhalese language written in English. In this paper, it is intended to propose the development of an improved phonetic matching algorithm which improved the accuracy of approximate string matching remarkably. This modified algorithm outperforms the phonetic matching algorithms available in the literature, when applied on datasets containing Sinhalese names and words written in English. In addition, it demonstrates a computational time comparable with phonetic matching algorithms available in the literature. Thus, the modified algorithm which we name “SPARCL” outperforms other phonetic matching algorithms and is illustrated with a real life application.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信