Implementing a Scalable, Secure Genomics Ingest and Processing Pipeline in a Trusted Research Environment for Dementia Research.

IF 2.2 Q3 HEALTH CARE SCIENCES & SERVICES
International Journal of Population Data Science Pub Date : 2026-07-06 eCollection Date: 2026-01-01 DOI:10.23889/ijpds.v11i5.3709
Alieyeh Saraband Moghaddam, Lewis Hotchkiss, Emma Squires, Simon Thompson
{"title":"Implementing a Scalable, Secure Genomics Ingest and Processing Pipeline in a Trusted Research Environment for Dementia Research.","authors":"Alieyeh Saraband Moghaddam, Lewis Hotchkiss, Emma Squires, Simon Thompson","doi":"10.23889/ijpds.v11i5.3709","DOIUrl":null,"url":null,"abstract":"<p><p>The integration of genomics data into dementia research offers transformative potential for understanding disease mechanisms and enabling precision medicine. However, its utility is constrained by significant challenges in data sharing, privacy, standardization, and computational scale. To address these barriers, we designed and implemented a secure, novel and scalable genomics ingest and processing pipeline within the Dementias Platform UK (DPUK) Trusted Research Environment. Our comprehensive, end-to-end framework encompasses a seven-stage process, including cohort discovery via an interactive metadata matrix, rigorous quality and privacy controls using bioinformatic tools (e.g. PLINK, VCFtools, etc.), a genomic data organization standard for scalability and balance between interoperability and flexibility, as well as secure provisioning within a Five Safes governance model. A key innovation is the use of a MinIO-based object storage architecture with custom metadata tagging, enabling efficient, privacy-preserving data access at large scale. We also operationalized a standardized polygenic risk score (PRS) pipeline to generate validated, derived datasets. This integrated system now facilitates secure research access to harmonized genomic data across 15 diverse cohorts, including population-based, clinical, and family studies, significantly expanding the resources available for dementia research. This work presents a replicable and governance-first model for the responsible management of complex, high-volume linked data. Looking ahead, we plan to migrate key computational modules, particularly the PRS generation and quality control workflows, to Nextflow. This migration will enhance computational reproducibility, enable portable and parallelized execution across high-performance environments, and further standardize analytical processes, directly advancing the methodological innovation and scalability goals of population data science.</p>","PeriodicalId":36483,"journal":{"name":"International Journal of Population Data Science","volume":"11 5","pages":"3709"},"PeriodicalIF":2.2000,"publicationDate":"2026-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13426568/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Population Data Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23889/ijpds.v11i5.3709","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/1/1 0:00:00","PubModel":"eCollection","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

The integration of genomics data into dementia research offers transformative potential for understanding disease mechanisms and enabling precision medicine. However, its utility is constrained by significant challenges in data sharing, privacy, standardization, and computational scale. To address these barriers, we designed and implemented a secure, novel and scalable genomics ingest and processing pipeline within the Dementias Platform UK (DPUK) Trusted Research Environment. Our comprehensive, end-to-end framework encompasses a seven-stage process, including cohort discovery via an interactive metadata matrix, rigorous quality and privacy controls using bioinformatic tools (e.g. PLINK, VCFtools, etc.), a genomic data organization standard for scalability and balance between interoperability and flexibility, as well as secure provisioning within a Five Safes governance model. A key innovation is the use of a MinIO-based object storage architecture with custom metadata tagging, enabling efficient, privacy-preserving data access at large scale. We also operationalized a standardized polygenic risk score (PRS) pipeline to generate validated, derived datasets. This integrated system now facilitates secure research access to harmonized genomic data across 15 diverse cohorts, including population-based, clinical, and family studies, significantly expanding the resources available for dementia research. This work presents a replicable and governance-first model for the responsible management of complex, high-volume linked data. Looking ahead, we plan to migrate key computational modules, particularly the PRS generation and quality control workflows, to Nextflow. This migration will enhance computational reproducibility, enable portable and parallelized execution across high-performance environments, and further standardize analytical processes, directly advancing the methodological innovation and scalability goals of population data science.

在可信赖的研究环境中实现可扩展的、安全的基因组学摄取和处理管道,用于痴呆症研究。
将基因组学数据整合到痴呆症研究中,为理解疾病机制和实现精准医疗提供了变革性的潜力。然而,它的实用性受到数据共享、隐私、标准化和计算规模方面的重大挑战的限制。为了解决这些障碍,我们在英国痴呆症平台(DPUK)可信研究环境中设计并实现了一个安全、新颖、可扩展的基因组摄取和处理管道。我们全面的端到端框架包括七个阶段的流程,包括通过交互式元数据矩阵进行队列发现,使用生物信息学工具(例如PLINK, VCFtools等)进行严格的质量和隐私控制,可扩展性和互操作性和灵活性之间的平衡的基因组数据组织标准,以及在Five safe治理模型中进行安全配置。一个关键的创新是使用了带有自定义元数据标记的基于minio的对象存储体系结构,从而实现了高效、保护隐私的大规模数据访问。我们还操作了标准化的多基因风险评分(PRS)管道,以生成经过验证的衍生数据集。这一综合系统现在促进了对15个不同队列的统一基因组数据的安全研究访问,包括基于人群的、临床的和家庭的研究,大大扩大了痴呆症研究的可用资源。这项工作提出了一个可复制的、治理优先的模型,用于负责任地管理复杂的、大量的关联数据。展望未来,我们计划将关键的计算模块,特别是PRS生成和质量控制工作流程迁移到Nextflow。这种迁移将增强计算的可重复性,在高性能环境中实现可移植和并行执行,并进一步标准化分析过程,直接推进人口数据科学的方法创新和可扩展性目标。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
2.50
自引率
0.00%
发文量
386
审稿时长
20 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书