The enduring advantages of the SLOW5 file format for raw nanopore sequencing data.

IF 11.8 2区 生物学 Q1 MULTIDISCIPLINARY SCIENCES
Hasindu Gamaarachchi, Sasha Jenner, Hiruna Samarakoon, James M Ferguson, Ira W Deveson
{"title":"The enduring advantages of the SLOW5 file format for raw nanopore sequencing data.","authors":"Hasindu Gamaarachchi, Sasha Jenner, Hiruna Samarakoon, James M Ferguson, Ira W Deveson","doi":"10.1093/gigascience/giaf118","DOIUrl":null,"url":null,"abstract":"<p><p>Nanopore sequencing is a widespread and important method in genomics science. The raw electrical current signal data from a typical nanopore sequencing experiment are large and complex. This can be stored in 2 alternative file formats that are presently supported: POD5 is a signal data file format used by default on instruments from Oxford Nanopore Technologies (ONT); SLOW5 is an open-source file format originally developed as an alternative to ONT's previous file format, which was known as FAST5. The choice of format may have important implications for the cost, speed, and simplicity of nanopore signal data analysis, management, and storage. To inform this choice, we present a comparative evaluation of POD5 versus SLOW5. We conducted benchmarking experiments assessing file size, analysis performance, and usability on a variety of different computer architectures. Binary SLOW5 (BLOW5) showed superior performance during sequential and nonsequential (random access) file reading on most systems, manifesting in faster, cheaper basecalling and other analysis, and we could find no instance in which POD5 file reading was significantly faster than BLOW5. We demonstrate that BLOW5 file writing is highly parallelizable, thereby meeting the demands of data acquisition on ONT instruments. Our analysis also identified differences in the complexity and stability of the software libraries for SLOW5 (slow5lib) and POD5 (pod5), including a large discrepancy in the number of underlying software dependencies, which may complicate the pod5 compilation process. In summary, many of the advantages originally conceived for SLOW5 remain relevant today, despite the replacement of FAST5 with POD5 as ONT's core file format.</p>","PeriodicalId":12581,"journal":{"name":"GigaScience","volume":"14 ","pages":""},"PeriodicalIF":11.8000,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12530089/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"GigaScience","FirstCategoryId":"99","ListUrlMain":"https://doi.org/10.1093/gigascience/giaf118","RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Nanopore sequencing is a widespread and important method in genomics science. The raw electrical current signal data from a typical nanopore sequencing experiment are large and complex. This can be stored in 2 alternative file formats that are presently supported: POD5 is a signal data file format used by default on instruments from Oxford Nanopore Technologies (ONT); SLOW5 is an open-source file format originally developed as an alternative to ONT's previous file format, which was known as FAST5. The choice of format may have important implications for the cost, speed, and simplicity of nanopore signal data analysis, management, and storage. To inform this choice, we present a comparative evaluation of POD5 versus SLOW5. We conducted benchmarking experiments assessing file size, analysis performance, and usability on a variety of different computer architectures. Binary SLOW5 (BLOW5) showed superior performance during sequential and nonsequential (random access) file reading on most systems, manifesting in faster, cheaper basecalling and other analysis, and we could find no instance in which POD5 file reading was significantly faster than BLOW5. We demonstrate that BLOW5 file writing is highly parallelizable, thereby meeting the demands of data acquisition on ONT instruments. Our analysis also identified differences in the complexity and stability of the software libraries for SLOW5 (slow5lib) and POD5 (pod5), including a large discrepancy in the number of underlying software dependencies, which may complicate the pod5 compilation process. In summary, many of the advantages originally conceived for SLOW5 remain relevant today, despite the replacement of FAST5 with POD5 as ONT's core file format.

用于原始纳米孔测序数据的SLOW5文件格式的持久优势。
纳米孔测序是基因组学中一种广泛而重要的方法。典型的纳米孔测序实验的原始电流信号数据大而复杂。这可以存储在目前支持的2种可选文件格式中:POD5是牛津纳米孔技术公司(ONT)仪器默认使用的信号数据文件格式;SLOW5是一种开源文件格式,最初是作为ONT之前的文件格式FAST5的替代方案而开发的。格式的选择可能会对纳米孔信号数据分析、管理和存储的成本、速度和简单性产生重要影响。为了说明这一选择,我们对POD5和SLOW5进行了比较评估。我们进行了基准测试实验,在各种不同的计算机体系结构上评估文件大小、分析性能和可用性。在大多数系统上,二进制SLOW5 (BLOW5)在顺序和非顺序(随机访问)文件读取时表现出优越的性能,表现为更快、更便宜的基调用和其他分析,我们没有发现POD5文件读取明显快于BLOW5的实例。我们证明BLOW5文件写入具有高度并行性,从而满足ONT仪器上数据采集的需求。我们的分析还发现了SLOW5 (slow5lib)和POD5 (POD5)的软件库在复杂性和稳定性方面的差异,包括底层软件依赖项数量的巨大差异,这可能会使POD5的编译过程复杂化。总之,尽管用POD5取代了FAST5作为ONT的核心文件格式,但最初为SLOW5设想的许多优点今天仍然具有相关性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
GigaScience
GigaScience MULTIDISCIPLINARY SCIENCES-
CiteScore
15.50
自引率
1.10%
发文量
119
审稿时长
1 weeks
期刊介绍: GigaScience seeks to transform data dissemination and utilization in the life and biomedical sciences. As an online open-access open-data journal, it specializes in publishing "big-data" studies encompassing various fields. Its scope includes not only "omic" type data and the fields of high-throughput biology currently serviced by large public repositories, but also the growing range of more difficult-to-access data, such as imaging, neuroscience, ecology, cohort data, systems biology and other new types of large-scale shareable data.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信