pangeo-cmip6 / sync

Workflows to keep CMIP6 data synchronized between GCS and S3 storage
2 stars 1 forks source link

Update jobs to reflect new prefixes #4

Closed charlesbluca closed 3 years ago

charlesbluca commented 3 years ago

I have updated the directory names to reflect the new structure. I hope it got it all right

naomi-henderson commented 3 years ago

Ah, I am confused about what is in GFDL-CM26_HighResMIP_CMIP5 - seems like this was from a CMIP5 model? Then it does not belong in the CMIP6/HighResMIP/

naomi-henderson commented 3 years ago

Yes, probably both a 'remainder' job for gs://cmip/CMIP6, and another for gs://cmip/

charlesbluca commented 3 years ago

Ah, I am confused about what is in GFDL-CM26_HighResMIP_CMIP5 - seems like this was from a CMIP5 model? Then it does not belong in the CMIP6/HighResMIP/

Does this mean HighResMIP should be in CMIP5/ instead?

Yes, probably both a 'remainder' job for gs://cmip/CMIP6, and another for gs://cmip/

Okay! I'll get to working on an additional job for the CMIP6_remainder, and them from there I think the rest should just be restructuring GFDL-CM26_HighResMIP_CMIP5.

naomi-henderson commented 3 years ago

Actually I don't know anything about either gs://cmip6/GFDL_CM2_6/ or gs://cmip6/gfdl_cm2_6.json - I thought these were yours? I would keep them separate, like tracmip.

naomi-henderson commented 3 years ago

@charlesbluca , I do not have write access to your repository, so if you go ahead and merge your pull request then we can give it a try. There are some more issues, but I would rather fix them after you have merged yours.

charlesbluca commented 3 years ago

Thanks for handling the changes! GFDL_CM2_6/ is something I added, so I agree with keeping it separate.

I'll merge this in and give you write access for the future.