Presentation Information
[7MgO-EqD-04]OceanDataStore: Cloud-Native Ocean Data for Research, Collaboration and Scalable Science.
*Jon Blower1, Oliver Tooth1 (1. National Oceanography Centre (UK))
The growth of high-resolution ocean models, sustained observing systems and machine learning applications is transforming marine science, but also bringing new challenges in how large datasets are stored, maintained and distributed. OceanDataStore is an open-source library developed to streamline writing, updating and accessing ocean model and observational datasets by leveraging cloud object storage, enabling more scalable and accessible ocean science throughout the research community.
Developed by the National Oceanography Centre (NOC), OceanDataStore has evolved into a production-ready platform serving both data producers and data consumers. For ocean modellers, the library provides command-line and scripting interfaces to transform archival datasets (e.g., netCDF) into Analysis-Ready Cloud Optimised (ARCO) formats, including version-controlled data cubes. For users of ocean data, the accompanying OceanDataCatalog enables dataset discovery and access using Spatio-Temporal Asset Catalog (STAC), allowing researchers, students and stakeholders to access public ocean datasets seamlessly across local and high-performance computing environments.
Developed through the AtlantiS National Capability programme and now integrated into NOC's global ocean modelling pipelines, OceanDataStore has transformed how we distribute ocean model outputs, including through the Earthmover Data Marketplace. This work provides a foundation for future digital services that prioritise data accessibility, accelerate multidisciplinary research, and broaden access to strategic ocean datasets across the wider NERC community.
Developed by the National Oceanography Centre (NOC), OceanDataStore has evolved into a production-ready platform serving both data producers and data consumers. For ocean modellers, the library provides command-line and scripting interfaces to transform archival datasets (e.g., netCDF) into Analysis-Ready Cloud Optimised (ARCO) formats, including version-controlled data cubes. For users of ocean data, the accompanying OceanDataCatalog enables dataset discovery and access using Spatio-Temporal Asset Catalog (STAC), allowing researchers, students and stakeholders to access public ocean datasets seamlessly across local and high-performance computing environments.
Developed through the AtlantiS National Capability programme and now integrated into NOC's global ocean modelling pipelines, OceanDataStore has transformed how we distribute ocean model outputs, including through the Earthmover Data Marketplace. This work provides a foundation for future digital services that prioritise data accessibility, accelerate multidisciplinary research, and broaden access to strategic ocean datasets across the wider NERC community.
Comment
To browse or post comments, you must log in.Log in