JAPO: learning join and pushdown order for cloud-native join optimization

IF 3.4 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS
Yuchen Yuan, Xiaoyue Feng, Bo Zhang, Pengyi Zhang, Jie Song
{"title":"JAPO: learning join and pushdown order for cloud-native join optimization","authors":"Yuchen Yuan, Xiaoyue Feng, Bo Zhang, Pengyi Zhang, Jie Song","doi":"10.1007/s11704-024-3937-z","DOIUrl":null,"url":null,"abstract":"<p>In this paper, we introduce JAPO which learn the join and pushdown order through DRL. The main idea is that the DRL agent learns better decisions based on the experiences by monitoring the rewards and latencies via trying different actions. The results show that our method can generate good plans both on join order and pushdown order. We also show that our method can select the well-performed distributed index placement via experiments. In the future, we plan to deploy JAPO to real systems execution and consider more factors in JAPO, such as different join types.</p>","PeriodicalId":12640,"journal":{"name":"Frontiers of Computer Science","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2024-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers of Computer Science","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s11704-024-3937-z","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

In this paper, we introduce JAPO which learn the join and pushdown order through DRL. The main idea is that the DRL agent learns better decisions based on the experiences by monitoring the rewards and latencies via trying different actions. The results show that our method can generate good plans both on join order and pushdown order. We also show that our method can select the well-performed distributed index placement via experiments. In the future, we plan to deploy JAPO to real systems execution and consider more factors in JAPO, such as different join types.

JAPO:学习连接和下推顺序,实现云原生连接优化
在本文中,我们介绍了通过 DRL 学习加入和下推顺序的 JAPO。其主要思想是,DRL 代理通过监控尝试不同行动的回报和延迟,根据经验学习更好的决策。结果表明,我们的方法能根据连接顺序和下推顺序生成良好的计划。我们还通过实验证明,我们的方法可以选择性能良好的分布式索引位置。未来,我们计划将 JAPO 部署到实际系统中执行,并在 JAPO 中考虑更多因素,如不同的连接类型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Frontiers of Computer Science
Frontiers of Computer Science COMPUTER SCIENCE, INFORMATION SYSTEMS-COMPUTER SCIENCE, SOFTWARE ENGINEERING
CiteScore
8.60
自引率
2.40%
发文量
799
审稿时长
6-12 weeks
期刊介绍: Frontiers of Computer Science aims to provide a forum for the publication of peer-reviewed papers to promote rapid communication and exchange between computer scientists. The journal publishes research papers and review articles in a wide range of topics, including: architecture, software, artificial intelligence, theoretical computer science, networks and communication, information systems, multimedia and graphics, information security, interdisciplinary, etc. The journal especially encourages papers from new emerging and multidisciplinary areas, as well as papers reflecting the international trends of research and development and on special topics reporting progress made by Chinese computer scientists.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信