Proceedings of the 11th International Workshop on Data Management on New Hardware最新文献

筛选

英文中文

Efficient Lightweight Compression Alongside Fast Scans 高效轻量级压缩和快速扫描

Proceedings of the 11th International Workshop on Data Management on New Hardware Pub Date : 2015-05-31 DOI: 10.1145/2771937.2771943

Orestis Polychroniou, K. A. Ross

{"title":"Efficient Lightweight Compression Alongside Fast Scans","authors":"Orestis Polychroniou, K. A. Ross","doi":"10.1145/2771937.2771943","DOIUrl":"https://doi.org/10.1145/2771937.2771943","url":null,"abstract":"The increasing main-memory capacity has allowed query execution to occur primarily in main memory. Database systems employ compression, not only to fit the data in main memory, but also to address the memory bandwidth bottleneck. Lightweight compression schemes focus on efficiency over compression rate and allow query operators to process the data in compressed form. For instance, dictionary compression keeps the distinct column values in a sorted dictionary and stores the values as index codes with the minimum number of bits. Packing the bits of each code contiguously, namely horizontal bit packing, has been optimized by using SIMD instructions for unpacking and by evaluating predicates in parallel per processor word for selection scans. Interleaving the bits of codes, namely vertical bit packing, provides faster scans, but incurs prohibitive costs for packing and unpacking. Here, we improve packing and unpacking for vertical bit packing using SIMD instructions, achieving more than an order of magnitude speedup. Also, we optimize horizontal bit packing on the latest CPUs and compare all approaches. While no single variant is better in all cases, vertical bit packing offers a good trade-off by combining the fastest scans with comparably fast packing and unpacking.","PeriodicalId":267524,"journal":{"name":"Proceedings of the 11th International Workshop on Data Management on New Hardware","volume":"527 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124495887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 33

By their fruits shall ye know them: A Data Analyst's Perspective on Massively Parallel System Design 通过他们的成果，你应该了解他们:一个数据分析师对大规模并行系统设计的看法

Proceedings of the 11th International Workshop on Data Management on New Hardware Pub Date : 2015-05-31 DOI: 10.1145/2771937.2771944

H. Pirk, S. Madden, M. Stonebraker

引用次数: 4

Proceedings of the 11th International Workshop on Data Management on New Hardware 第11届新硬件数据管理国际研讨会论文集

Proceedings of the 11th International Workshop on Data Management on New Hardware Pub Date : 1900-01-01 DOI: 10.1145/2771937

引用次数: 0

首页上一页