search

pangeo-forge / staged-recipes

A place to submit pangeo-forge recipes before they become fully fledged pangeo-forge feedstocks
https://pangeo-forge.readthedocs.io/en/latest/
Apache License 2.0
39 stars 63 forks source link

adding ANTGG-2015 recipe #265

Open mdtanker opened 9 months ago

mdtanker commented 9 months ago

I run a Python package called PolarToolkit that includes a module with lots of Pooch calls for downloading datasets common to Polar/Cryospheric research. I have been wanted to allow users to stream some of these datasets from the cloud instead of having to download the files to their local machines. I just found Pangeo, which seems to be a perfect solution to this (correct me if I'm wrong!).

I'm quite new to all of this, but have tried to piece together the correct way to implement a recipe. I started with a simple dataset of Antarctic gravity data (ANTGG), which requires minimal preprocessing, is a single netCDF, and is hosted on PANGAEA.

Please let me know if I there's anything to change.

Thanks for provided a great resource!

mdtanker commented 9 months ago

I just saw in this comment that submitting stage-recipes is not currently maintained by pangeo-forge. If thats the case, I'm happy to close this PR for now.

norlandrhagen commented 9 months ago

Hey @mdtanker! Thanks for posting an issue. You are correct, the staged-recipes infrastructure of pangeo-forge has been mostly depreciated. However, pangeo-forge-recipes, the ETL tool is still in development. Your recipe looks like it's going in the right direction. You could try running it via the local (direct) runner.

If you want to swing by one of the bi-weekly coordination meetings, the schedule is here and I would be happy to help.