Data Processing and Management at PMEL: A 50-Year Perspective

IF 3.2 4区地球科学 Q1 OCEANOGRAPHY

Oceanography Pub Date : 2023-01-01 DOI:10.5670/oceanog.2023.230

Eugene Burger, Kevin O’Brien, Steven Hankin, Roland Schweitzer, Linus Kamb, Sage Osborne, Ansley Manke

{"title":"Data Processing and Management at PMEL: A 50-Year Perspective","authors":"Eugene Burger, Kevin O’Brien, Steven Hankin, Roland Schweitzer, Linus Kamb, Sage Osborne, Ansley Manke","doi":"10.5670/oceanog.2023.230","DOIUrl":null,"url":null,"abstract":"Over the last 50 years, the landscape of marine data management has been transformed. Previously, each research project held its data privately and managed them as local files on disk; today, it is standard practice to share data collaboratively over the internet, often integrated with web tools that provide a global community of scientists with ready access to data analysis and visualization. NOAA Pacific Marine Environmental Laboratory (PMEL) developers and data managers have made and continue to make pivotal contributions toward this evolution. This article examines contributions that include a community-wide standard for metadata storage (e.g., climate and forecast [CF] metadata conventions), a widely used desktop computer tool (PyFerret), a pioneering web server providing visualization and analysis of distributed data (Live Access Server), tailor-made data management systems for uncrewed ocean platforms, and new developments in applications of machine learning to data quality control. We also describe the evolution of in-house PMEL data management, from PMEL developed tools to an open-science, interoperable data approach.","PeriodicalId":54695,"journal":{"name":"Oceanography","volume":"101 1","pages":"0"},"PeriodicalIF":3.2000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Oceanography","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5670/oceanog.2023.230","RegionNum":4,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OCEANOGRAPHY","Score":null,"Total":0}

引用次数: 0

Abstract

Over the last 50 years, the landscape of marine data management has been transformed. Previously, each research project held its data privately and managed them as local files on disk; today, it is standard practice to share data collaboratively over the internet, often integrated with web tools that provide a global community of scientists with ready access to data analysis and visualization. NOAA Pacific Marine Environmental Laboratory (PMEL) developers and data managers have made and continue to make pivotal contributions toward this evolution. This article examines contributions that include a community-wide standard for metadata storage (e.g., climate and forecast [CF] metadata conventions), a widely used desktop computer tool (PyFerret), a pioneering web server providing visualization and analysis of distributed data (Live Access Server), tailor-made data management systems for uncrewed ocean platforms, and new developments in applications of machine learning to data quality control. We also describe the evolution of in-house PMEL data management, from PMEL developed tools to an open-science, interoperable data approach.

查看原文本刊更多论文

PMEL的数据处理和管理:50年的展望

在过去的50年里，海洋数据管理的格局已经发生了变化。以前，每个研究项目都私下保存数据，并将其作为磁盘上的本地文件进行管理;今天，在互联网上协作共享数据是标准做法，通常与网络工具集成，为全球科学家社区提供数据分析和可视化的现成访问。NOAA太平洋海洋环境实验室(PMEL)的开发人员和数据管理人员已经并将继续为这一演变做出关键贡献。本文研究的贡献包括社区范围的元数据存储标准(例如，气候和预报[CF]元数据约定)，广泛使用的桌面计算机工具(PyFerret)，提供分布式数据可视化和分析的开创性web服务器(Live Access server)，为无人海洋平台量身定制的数据管理系统，以及机器学习应用于数据质量控制的新发展。我们还描述了PMEL内部数据管理的演变，从PMEL开发的工具到开放科学，可互操作的数据方法。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Oceanography 地学-海洋学

CiteScore

6.10

自引率

3.60%

发文量

审稿时长

6-12 weeks

期刊介绍： First published in July 1988, Oceanography is the official magazine of The Oceanography Society. It contains peer-reviewed articles that chronicle all aspects of ocean science and its applications. In addition, Oceanography solicits and publishes news and information, meeting reports, hands-on laboratory exercises, career profiles, book reviews, and shorter, editor-reviewed articles that address public policy and education and how they are affected by science and technology. We encourage submission of short papers to the Breaking Waves section that describe novel approaches to multidisciplinary problems in ocean science.