导出事务接口到日志结构文件系统中的应用程序

Jiacheng Zhang, Youyou Lu, Keni Qiu, Zejun Shi, Hongsuk Choi, J. Shu
{"title":"导出事务接口到日志结构文件系统中的应用程序","authors":"Jiacheng Zhang, Youyou Lu, Keni Qiu, Zejun Shi, Hongsuk Choi, J. Shu","doi":"10.1109/NAS.2018.8515726","DOIUrl":null,"url":null,"abstract":"The write-ahead-logging (WAL) used in SQLite adopts roll-forward mechanism to ensure system consistency, which induces double writes of the updates due to the checkpointing procedure. F2FS is a recent proposed file system that is specifically designed and optimized for flash memory based storage. By leveraging the log-structured update pattern and the atomicity of filesystem-level checkpoint in F2FS, this paper proposes an index remapping mechanism to redirect the DB access to WAL. In this way, the write amplification caused by WAL checkpointing can be mitigated, which further improves the overall performance of the system. The atomicity of the remap operation and the WAL alignment format are discussed in details. In addition, crash recovery under the proposed framework is validated. The experimental results show that the proposed framework can effectively reduce the write traffic and improve system performance.","PeriodicalId":115970,"journal":{"name":"2018 IEEE International Conference on Networking, Architecture and Storage (NAS)","volume":"343 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Exporting Transactional Interface to Applications in Log-Structured File Systems\",\"authors\":\"Jiacheng Zhang, Youyou Lu, Keni Qiu, Zejun Shi, Hongsuk Choi, J. Shu\",\"doi\":\"10.1109/NAS.2018.8515726\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The write-ahead-logging (WAL) used in SQLite adopts roll-forward mechanism to ensure system consistency, which induces double writes of the updates due to the checkpointing procedure. F2FS is a recent proposed file system that is specifically designed and optimized for flash memory based storage. By leveraging the log-structured update pattern and the atomicity of filesystem-level checkpoint in F2FS, this paper proposes an index remapping mechanism to redirect the DB access to WAL. In this way, the write amplification caused by WAL checkpointing can be mitigated, which further improves the overall performance of the system. The atomicity of the remap operation and the WAL alignment format are discussed in details. In addition, crash recovery under the proposed framework is validated. The experimental results show that the proposed framework can effectively reduce the write traffic and improve system performance.\",\"PeriodicalId\":115970,\"journal\":{\"name\":\"2018 IEEE International Conference on Networking, Architecture and Storage (NAS)\",\"volume\":\"343 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 IEEE International Conference on Networking, Architecture and Storage (NAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/NAS.2018.8515726\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 IEEE International Conference on Networking, Architecture and Storage (NAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/NAS.2018.8515726","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

SQLite中使用的预写日志(write-ahead-logging, WAL)采用前滚机制来保证系统的一致性,但由于检查点过程的存在,导致了更新的双重写操作。F2FS是最近提出的一个文件系统,它是专门为基于闪存的存储而设计和优化的。通过利用F2FS中日志结构的更新模式和文件系统级检查点的原子性,本文提出了一种索引重映射机制,将DB访问重定向到WAL。这样可以减轻由WAL检查点引起的写放大,从而进一步提高系统的整体性能。详细讨论了重新映射操作的原子性和WAL对齐格式。此外,还验证了该框架下的崩溃恢复。实验结果表明,该框架可以有效地减少写流量,提高系统性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Exporting Transactional Interface to Applications in Log-Structured File Systems
The write-ahead-logging (WAL) used in SQLite adopts roll-forward mechanism to ensure system consistency, which induces double writes of the updates due to the checkpointing procedure. F2FS is a recent proposed file system that is specifically designed and optimized for flash memory based storage. By leveraging the log-structured update pattern and the atomicity of filesystem-level checkpoint in F2FS, this paper proposes an index remapping mechanism to redirect the DB access to WAL. In this way, the write amplification caused by WAL checkpointing can be mitigated, which further improves the overall performance of the system. The atomicity of the remap operation and the WAL alignment format are discussed in details. In addition, crash recovery under the proposed framework is validated. The experimental results show that the proposed framework can effectively reduce the write traffic and improve system performance.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信