通过将数据分析与在线数据存储库集成,推进开放和可复制的水数据科学

IF 4.8 2区 环境科学与生态学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Jeffery S. Horsburgh , Scott Black , Anthony Castronova , Pabitra K. Dash
{"title":"通过将数据分析与在线数据存储库集成,推进开放和可复制的水数据科学","authors":"Jeffery S. Horsburgh ,&nbsp;Scott Black ,&nbsp;Anthony Castronova ,&nbsp;Pabitra K. Dash","doi":"10.1016/j.envsoft.2025.106422","DOIUrl":null,"url":null,"abstract":"<div><div>Scientific and management challenges in the water domain require synthesis of diverse data. Many analysis tasks are difficult because datasets are large and complex, standard formats are not always agreed upon or mapped to efficient data structures, scientists may lack training for tackling large and complex datasets, and it can be difficult to share and reproduce data science workflows. Overcoming barriers to accessing, organizing, and preparing datasets for analyses can transform how water scientists work. Building on the HydroShare repository's cyberinfrastructure, we created a Python package that automates data retrieval, organization, and curation for analysis, reducing time spent in choosing appropriate data structures and writing data ingestion code. It manages metadata and automates data loading into performant structures consistent with Python's visualization, analysis, and data science capabilities and can be used to build and share more reproducible scientific workflows in HydroShare following FAIR (Findable, Accessible, Interoperable, and Reusable) principles.</div></div>","PeriodicalId":310,"journal":{"name":"Environmental Modelling & Software","volume":"188 ","pages":"Article 106422"},"PeriodicalIF":4.8000,"publicationDate":"2025-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Advancing open and reproducible water data science by integrating data analytics with an online data repository\",\"authors\":\"Jeffery S. Horsburgh ,&nbsp;Scott Black ,&nbsp;Anthony Castronova ,&nbsp;Pabitra K. Dash\",\"doi\":\"10.1016/j.envsoft.2025.106422\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Scientific and management challenges in the water domain require synthesis of diverse data. Many analysis tasks are difficult because datasets are large and complex, standard formats are not always agreed upon or mapped to efficient data structures, scientists may lack training for tackling large and complex datasets, and it can be difficult to share and reproduce data science workflows. Overcoming barriers to accessing, organizing, and preparing datasets for analyses can transform how water scientists work. Building on the HydroShare repository's cyberinfrastructure, we created a Python package that automates data retrieval, organization, and curation for analysis, reducing time spent in choosing appropriate data structures and writing data ingestion code. It manages metadata and automates data loading into performant structures consistent with Python's visualization, analysis, and data science capabilities and can be used to build and share more reproducible scientific workflows in HydroShare following FAIR (Findable, Accessible, Interoperable, and Reusable) principles.</div></div>\",\"PeriodicalId\":310,\"journal\":{\"name\":\"Environmental Modelling & Software\",\"volume\":\"188 \",\"pages\":\"Article 106422\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2025-03-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Environmental Modelling & Software\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1364815225001069\",\"RegionNum\":2,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Environmental Modelling & Software","FirstCategoryId":"93","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1364815225001069","RegionNum":2,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

水领域的科学和管理挑战需要综合各种数据。许多分析任务都很困难,因为数据集又大又复杂,标准格式并不总是达成一致或映射到有效的数据结构,科学家可能缺乏处理大型复杂数据集的培训,并且很难共享和复制数据科学工作流程。克服访问、组织和准备分析数据集的障碍可以改变水科学家的工作方式。在HydroShare存储库的网络基础设施的基础上,我们创建了一个Python包,它可以自动检索、组织和管理数据以进行分析,从而减少了选择合适的数据结构和编写数据摄取代码所花费的时间。它管理元数据并自动将数据加载到与Python的可视化、分析和数据科学功能一致的高性能结构中,并可用于在遵循FAIR(可查找、可访问、可互操作和可重用)原则的HydroShare中构建和共享更多可重复的科学工作流。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Advancing open and reproducible water data science by integrating data analytics with an online data repository
Scientific and management challenges in the water domain require synthesis of diverse data. Many analysis tasks are difficult because datasets are large and complex, standard formats are not always agreed upon or mapped to efficient data structures, scientists may lack training for tackling large and complex datasets, and it can be difficult to share and reproduce data science workflows. Overcoming barriers to accessing, organizing, and preparing datasets for analyses can transform how water scientists work. Building on the HydroShare repository's cyberinfrastructure, we created a Python package that automates data retrieval, organization, and curation for analysis, reducing time spent in choosing appropriate data structures and writing data ingestion code. It manages metadata and automates data loading into performant structures consistent with Python's visualization, analysis, and data science capabilities and can be used to build and share more reproducible scientific workflows in HydroShare following FAIR (Findable, Accessible, Interoperable, and Reusable) principles.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Environmental Modelling & Software
Environmental Modelling & Software 工程技术-工程:环境
CiteScore
9.30
自引率
8.20%
发文量
241
审稿时长
60 days
期刊介绍: Environmental Modelling & Software publishes contributions, in the form of research articles, reviews and short communications, on recent advances in environmental modelling and/or software. The aim is to improve our capacity to represent, understand, predict or manage the behaviour of environmental systems at all practical scales, and to communicate those improvements to a wide scientific and professional audience.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信