Managing Petabyte-Scale Storage for the ATLAS Tier-1 Centre at TRIUMF

D. Deatrich, Simon Y. Liu, Chris Payne, Réda Tafirout, R. Walker, A. Wong, M. Vetterli
{"title":"Managing Petabyte-Scale Storage for the ATLAS Tier-1 Centre at TRIUMF","authors":"D. Deatrich, Simon Y. Liu, Chris Payne, Réda Tafirout, R. Walker, A. Wong, M. Vetterli","doi":"10.1109/HPCS.2008.27","DOIUrl":null,"url":null,"abstract":"The ATLAS experiment at the Large Hadron Collider (LHC), located in Geneva, will collect 3 to 4 petabytes or PB (1015 bytes) of data for each year of its operation, when fully commissioned. Secondary data sets resulting from event reconstruction, reprocessing and calibration will result in an additional 2.5 PB for each year of data taking. Simulated data sets require also significant resources as well nearing 1 PB per year. The data will be distributed worldwide to ten Tier-1 computing centres within the Worldwide LHC computing grid (WLCG) that will operate around the clock. One of these centres is hosted at TRIUMF, Canada's National Laboratory for Particle and Nuclear Physics, located in Vancouver, BC. By the year 2010, the storage capacity at TRIUMF will consist of about 3 Petabyte of disk storage, and 2 PB of tape storage. At present, the disk capacity installed is 750 terabytes or TB (1012 bytes) while the tape capacity is 560 TB, both using state of the art technology. dCache from www.dcache.org is used to manage the entire storage in order to provide a common file namespace. It is a highly scalable solution and highly configurable. In this paper we will describe and review the storage infrastructure and configuration currently in place at the Tier-1 centre at TRIUMF for both disk and tape as well as the management software and tools that have been developed.","PeriodicalId":290167,"journal":{"name":"2008 22nd International Symposium on High Performance Computing Systems and Applications","volume":"27 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2008-06-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2008 22nd International Symposium on High Performance Computing Systems and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/HPCS.2008.27","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 6

Abstract

The ATLAS experiment at the Large Hadron Collider (LHC), located in Geneva, will collect 3 to 4 petabytes or PB (1015 bytes) of data for each year of its operation, when fully commissioned. Secondary data sets resulting from event reconstruction, reprocessing and calibration will result in an additional 2.5 PB for each year of data taking. Simulated data sets require also significant resources as well nearing 1 PB per year. The data will be distributed worldwide to ten Tier-1 computing centres within the Worldwide LHC computing grid (WLCG) that will operate around the clock. One of these centres is hosted at TRIUMF, Canada's National Laboratory for Particle and Nuclear Physics, located in Vancouver, BC. By the year 2010, the storage capacity at TRIUMF will consist of about 3 Petabyte of disk storage, and 2 PB of tape storage. At present, the disk capacity installed is 750 terabytes or TB (1012 bytes) while the tape capacity is 560 TB, both using state of the art technology. dCache from www.dcache.org is used to manage the entire storage in order to provide a common file namespace. It is a highly scalable solution and highly configurable. In this paper we will describe and review the storage infrastructure and configuration currently in place at the Tier-1 centre at TRIUMF for both disk and tape as well as the management software and tools that have been developed.
为TRIUMF的ATLAS Tier-1中心管理pb级存储
位于日内瓦的大型强子对撞机(LHC)的ATLAS实验,在完全投入使用后,每年将收集3到4 PB(1015字节)的数据。由事件重建、再处理和校准产生的次要数据集将导致每年数据采集额外2.5 PB。模拟数据集每年也需要大量的资源,接近1 PB。这些数据将分布到全球LHC计算网格(WLCG)内的10个Tier-1计算中心,这些中心将全天候运行。其中一个中心设在加拿大粒子和核物理国家实验室(TRIUMF),该实验室位于不列颠哥伦比亚省温哥华。到2010年,TRIUMF的存储容量将包括大约3pb的磁盘存储和2pb的磁带存储。目前安装的磁盘容量为750tb或TB(1012字节),磁带容量为560tb,都采用了最先进的技术。来自www.dcache.org的dCache用于管理整个存储,以提供一个通用的文件命名空间。它是一个高度可扩展和高度可配置的解决方案。在本文中,我们将描述和回顾目前在TRIUMF一级中心的磁盘和磁带存储基础设施和配置,以及已开发的管理软件和工具。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书