{"title":"Towards a universal approach for semantic interpretation of spreadsheets data","authors":"N. Dorodnykh, A. Y. Yurin","doi":"10.1145/3410566.3410609","DOIUrl":null,"url":null,"abstract":"Spreadsheets are a popular way to represent and structure data and knowledge; in this connection semantic interpretation of spreadsheets data has become an active area of scientific research. In this paper, we propose a new approach for semantic interpretation of data extracted from spreadsheets with arbitrary layouts and styles. Analyzed spreadsheets are presented in the MS Excel format. In particular, our approach includes two stages: analyzing and transforming source spreadsheets to spreadsheets in a relational canonicalized form; annotating canonical spreadsheets by entities from a knowledge graph. At the first stage we use a rule-based approach implemented in the form of a domain-specific language called Cells Rule Language (CRL), and an original form of a canonical table. At the second stage we use an aggregated method for defining similarity between candidate entities and cell values that consists of the sequential application of five metrics and combining ranks obtained by each metric. Algorithms of each stage are implemented in the form of special software: TabbyXL and TabbyLD respectively. DBpedia is used as a knowledge graph. Experimental evaluations of our proposals are obtained for T2Dv2 and Troy200 corpuses, and they demonstrates the applicability of our approach and software for semantic spreadsheet data interpretation. The feature of the approach is its universality due to the use of the language for describing spreadsheets transformation rules, as well as an original canonical form. This feature provides processing large volumes of heterogeneous spreadsheets in various domains. This work is a part of the Tabby research project for software development of recognition, extraction, transformation and interpretation of data from spreadsheet tables with arbitrary layouts and styles.","PeriodicalId":137708,"journal":{"name":"Proceedings of the 24th Symposium on International Database Engineering & Applications","volume":"35 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 24th Symposium on International Database Engineering & Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3410566.3410609","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3
Abstract
Spreadsheets are a popular way to represent and structure data and knowledge; in this connection semantic interpretation of spreadsheets data has become an active area of scientific research. In this paper, we propose a new approach for semantic interpretation of data extracted from spreadsheets with arbitrary layouts and styles. Analyzed spreadsheets are presented in the MS Excel format. In particular, our approach includes two stages: analyzing and transforming source spreadsheets to spreadsheets in a relational canonicalized form; annotating canonical spreadsheets by entities from a knowledge graph. At the first stage we use a rule-based approach implemented in the form of a domain-specific language called Cells Rule Language (CRL), and an original form of a canonical table. At the second stage we use an aggregated method for defining similarity between candidate entities and cell values that consists of the sequential application of five metrics and combining ranks obtained by each metric. Algorithms of each stage are implemented in the form of special software: TabbyXL and TabbyLD respectively. DBpedia is used as a knowledge graph. Experimental evaluations of our proposals are obtained for T2Dv2 and Troy200 corpuses, and they demonstrates the applicability of our approach and software for semantic spreadsheet data interpretation. The feature of the approach is its universality due to the use of the language for describing spreadsheets transformation rules, as well as an original canonical form. This feature provides processing large volumes of heterogeneous spreadsheets in various domains. This work is a part of the Tabby research project for software development of recognition, extraction, transformation and interpretation of data from spreadsheet tables with arbitrary layouts and styles.
电子表格是一种表示和构建数据和知识的流行方式;在这方面,电子表格数据的语义解释已成为一个活跃的科学研究领域。在本文中,我们提出了一种新的方法来语义解释从具有任意布局和样式的电子表格中提取的数据。分析的电子表格以MS Excel格式呈现。具体来说,我们的方法包括两个阶段:分析源电子表格并将其转换为关系规范化形式的电子表格;通过知识图中的实体标注规范电子表格。在第一阶段,我们使用一种基于规则的方法,这种方法以称为cell Rule language (CRL)的领域特定语言的形式实现,并使用规范化表的原始形式。在第二阶段,我们使用聚合方法来定义候选实体和单元格值之间的相似性,该方法由五个指标的顺序应用和每个指标获得的组合排名组成。各阶段算法分别以TabbyXL和TabbyLD专用软件的形式实现。DBpedia被用作知识图。我们的建议在T2Dv2和Troy200语料库上进行了实验评估,并证明了我们的方法和软件在语义电子表格数据解释方面的适用性。该方法的特点是它的通用性,因为它使用了描述电子表格转换规则的语言,以及原始的规范形式。该特性提供了在不同领域处理大量异构电子表格的能力。这项工作是Tabby研究项目的一部分,该项目用于从具有任意布局和样式的电子表格中识别、提取、转换和解释数据的软件开发。