问题解答系统 GeoQA2 及其新的评估基准

IF 7.6 Q1 REMOTE SENSING

International journal of applied earth observation and geoinformation : ITC journal Pub Date : 2024-10-16 DOI:10.1016/j.jag.2024.104203

Sergios-Anestis Kefalidis , Dharmen Punjani , Eleni Tsalapati , Konstantinos Plas , Maria-Aggeliki Pollali , Pierre Maret , Manolis Koubarakis

{"title":"问题解答系统 GeoQA2 及其新的评估基准","authors":"Sergios-Anestis Kefalidis , Dharmen Punjani , Eleni Tsalapati , Konstantinos Plas , Maria-Aggeliki Pollali , Pierre Maret , Manolis Koubarakis","doi":"10.1016/j.jag.2024.104203","DOIUrl":null,"url":null,"abstract":"<div><div>We present the question answering engine GeoQA2 which is able to answer geospatial questions over the union of knowledge graphs YAGO2 and YAGO2geo. We also present the dataset <span>GeoQuestions1089</span> which consists of 1089 natural language questions, their corresponding SPARQL or GeoSPARQL queries and their answers over the union of the same knowledge graphs. We use this dataset to compare the effectiveness of GeoQA2 and the system of Hamzei et al. 2022 and make it publicly available to be used by other researchers. Our evaluation shows that although the engine GeoQA2 performs better than the engine of Hamzei et al. 2022, both engines have ample room for improvement in their question answering performance.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"134 ","pages":"Article 104203"},"PeriodicalIF":7.6000,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The question answering system GeoQA2 and a new benchmark for its evaluation\",\"authors\":\"Sergios-Anestis Kefalidis , Dharmen Punjani , Eleni Tsalapati , Konstantinos Plas , Maria-Aggeliki Pollali , Pierre Maret , Manolis Koubarakis\",\"doi\":\"10.1016/j.jag.2024.104203\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>We present the question answering engine GeoQA2 which is able to answer geospatial questions over the union of knowledge graphs YAGO2 and YAGO2geo. We also present the dataset <span>GeoQuestions1089</span> which consists of 1089 natural language questions, their corresponding SPARQL or GeoSPARQL queries and their answers over the union of the same knowledge graphs. We use this dataset to compare the effectiveness of GeoQA2 and the system of Hamzei et al. 2022 and make it publicly available to be used by other researchers. Our evaluation shows that although the engine GeoQA2 performs better than the engine of Hamzei et al. 2022, both engines have ample room for improvement in their question answering performance.</div></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":\"134 \",\"pages\":\"Article 104203\"},\"PeriodicalIF\":7.6000,\"publicationDate\":\"2024-10-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843224005594\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843224005594","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}

引用次数: 0

摘要

我们介绍的问题解答引擎 GeoQA2 能够回答 YAGO2 和 YAGO2geo 知识图谱联合体上的地理空间问题。我们还介绍了数据集 GeoQuestions1089，该数据集由 1089 个自然语言问题、相应的 SPARQL 或 GeoSPARQL 查询及其在相同知识图谱结合体上的答案组成。我们利用这个数据集来比较 GeoQA2 和 Hamzei 等人的系统 2022 的有效性，并将其公开供其他研究人员使用。我们的评估结果表明，尽管 GeoQA2 引擎的性能优于 Hamzei 等人的 2022 引擎，但这两个引擎的问题解答性能都有很大的提升空间。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

The question answering system GeoQA2 and a new benchmark for its evaluation

We present the question answering engine GeoQA2 which is able to answer geospatial questions over the union of knowledge graphs YAGO2 and YAGO2geo. We also present the dataset GeoQuestions1089 which consists of 1089 natural language questions, their corresponding SPARQL or GeoSPARQL queries and their answers over the union of the same knowledge graphs. We use this dataset to compare the effectiveness of GeoQA2 and the system of Hamzei et al. 2022 and make it publicly available to be used by other researchers. Our evaluation shows that although the engine GeoQA2 performs better than the engine of Hamzei et al. 2022, both engines have ample room for improvement in their question answering performance.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

International journal of applied earth observation and geoinformation : ITC journal Global and Planetary Change, Management, Monitoring, Policy and Law, Earth-Surface Processes, Computers in Earth Sciences

CiteScore

12.00

自引率

0.00%

发文量

审稿时长

77 days

期刊介绍： The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.