pangeo-data / pangeo-cmip6-cloud

Documentation for Pangeo CMIP6 data stored in GCP/AWS cloud
https://pangeo-data.github.io/pangeo-cmip6-cloud/
17 stars 9 forks source link

Reactivate Retraction Logic #69

Open jbusecke opened 10 months ago

jbusecke commented 10 months ago

I just got access to the public bucket back, and that seems to work. This job still fails, but it is not because the authentication!

In this PR I am applying a few things that I have learned over the past.

1) The replica keyword for the ESGF query is quite confusing to me. Writing this I wrongly assumed that setting this to false I would only get the results for all the (distributed) master records, but after my recent experience I am not so sure about that. According to the ESGF API repo I believe just leaving this as the default it the way to go.

That last job timed out because it would time out for the dkrz node, so I am deactivating that for now.

jbusecke commented 10 months ago

Test running here