{"title":"研究基于规则的数据引擎的学习连接顺序优化策略","authors":"Antonios Karvelas, Yannis Foufoulas, Alkis Simitsis, Yannis Ioannidis","doi":"10.1007/s10796-024-10555-1","DOIUrl":null,"url":null,"abstract":"<p>A recent trend in data management research investigates whether machine learning techniques could improve or replace core components of traditional database architectures, such as the query optimizer or selectivity and cardinality cost estimators. The preliminary approaches leverage cost-based optimizers and cost models to avoid a cold-start as they train and build learning models. In this work, we investigate whether learning could also be beneficial in rule-based optimizers, which instead of driving query execution decisions via a cost model they rely on a set of fixed rules and pre-defined heuristics. Our experimental testbed employs MonetDB, an open-source, column-store analytics data engine, and explore whether a learning model using Graph Neural Networks (GNNs) that is trained on a cost-based engine, such as PostgreSQL, could improve MonetDB optimizer’s decisions. Our initial findings reveal that our approach could improve significantly MonetDB’s query execution plans, especially as the query complexity increases whet it involves many join operators.</p>","PeriodicalId":13610,"journal":{"name":"Information Systems Frontiers","volume":"8 1","pages":""},"PeriodicalIF":6.9000,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Investigating Learning Join Order Optimization Strategies for Rule-based Data Engines\",\"authors\":\"Antonios Karvelas, Yannis Foufoulas, Alkis Simitsis, Yannis Ioannidis\",\"doi\":\"10.1007/s10796-024-10555-1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>A recent trend in data management research investigates whether machine learning techniques could improve or replace core components of traditional database architectures, such as the query optimizer or selectivity and cardinality cost estimators. The preliminary approaches leverage cost-based optimizers and cost models to avoid a cold-start as they train and build learning models. In this work, we investigate whether learning could also be beneficial in rule-based optimizers, which instead of driving query execution decisions via a cost model they rely on a set of fixed rules and pre-defined heuristics. Our experimental testbed employs MonetDB, an open-source, column-store analytics data engine, and explore whether a learning model using Graph Neural Networks (GNNs) that is trained on a cost-based engine, such as PostgreSQL, could improve MonetDB optimizer’s decisions. Our initial findings reveal that our approach could improve significantly MonetDB’s query execution plans, especially as the query complexity increases whet it involves many join operators.</p>\",\"PeriodicalId\":13610,\"journal\":{\"name\":\"Information Systems Frontiers\",\"volume\":\"8 1\",\"pages\":\"\"},\"PeriodicalIF\":6.9000,\"publicationDate\":\"2024-11-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Systems Frontiers\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s10796-024-10555-1\",\"RegionNum\":3,\"RegionCategory\":\"管理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Systems Frontiers","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s10796-024-10555-1","RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Investigating Learning Join Order Optimization Strategies for Rule-based Data Engines
A recent trend in data management research investigates whether machine learning techniques could improve or replace core components of traditional database architectures, such as the query optimizer or selectivity and cardinality cost estimators. The preliminary approaches leverage cost-based optimizers and cost models to avoid a cold-start as they train and build learning models. In this work, we investigate whether learning could also be beneficial in rule-based optimizers, which instead of driving query execution decisions via a cost model they rely on a set of fixed rules and pre-defined heuristics. Our experimental testbed employs MonetDB, an open-source, column-store analytics data engine, and explore whether a learning model using Graph Neural Networks (GNNs) that is trained on a cost-based engine, such as PostgreSQL, could improve MonetDB optimizer’s decisions. Our initial findings reveal that our approach could improve significantly MonetDB’s query execution plans, especially as the query complexity increases whet it involves many join operators.
期刊介绍:
The interdisciplinary interfaces of Information Systems (IS) are fast emerging as defining areas of research and development in IS. These developments are largely due to the transformation of Information Technology (IT) towards networked worlds and its effects on global communications and economies. While these developments are shaping the way information is used in all forms of human enterprise, they are also setting the tone and pace of information systems of the future. The major advances in IT such as client/server systems, the Internet and the desktop/multimedia computing revolution, for example, have led to numerous important vistas of research and development with considerable practical impact and academic significance. While the industry seeks to develop high performance IS/IT solutions to a variety of contemporary information support needs, academia looks to extend the reach of IS technology into new application domains. Information Systems Frontiers (ISF) aims to provide a common forum of dissemination of frontline industrial developments of substantial academic value and pioneering academic research of significant practical impact.