cordex-feedstock

This repository contains the pangeo-forge feedstock to extract CORDEX data from ESGF and upload it to the EURO-CORDEX S3 bucket on AWS. The workflow utilizes the pangeo-forge-cordex package for accessing the ESGF API and prepares the input for extracting and converting datasets using pangeo-forge-recipes.

deploy

Run locally with

pangeo-forge-runner bake --repo=. -f=config/local.json --Bake.recipe_id=euro-cordex --Bake.job_name=test --prune

To open a locally create dataset

import xarray as xr
import fsspec

url = "target/cordex.output.EUR-11.GERICS.NOAA-GFDL-GFDL-ESM2G.rcp26.r1i1p1.REMO2015.v1.mon.pr.v20180710.zarr"

ds = xr.open_zarr(
    store=fsspec.get_mapper(url), consolidated=True
)

aws flink

pangeo-forge-runner bake --repo=. --ref beam-refactor --config=./config/s3fs-flink.json --prune --FlinkOperatorBakery.parallelism=10 --Bake.job_name=awstest

references

This feedstock is based on the CMIP6-leap-feedstock.