cedadev / cmip6-object-store

CMIP6 Object Store Library
BSD 3-Clause "New" or "Revised" License
4 stars 4 forks source link

deal with datasets in both error and zarr pickles #55

Open alaniwi opened 3 years ago

alaniwi commented 3 years ago

branch alan_dev is nearly ready to merge to master, but first need to deal with the following issue:

In convert_pickle.py, need to treat any datasets that are in both zarrs and error pickle as being in error only. Then test that convert_pickle.py can be run twice in succession and the second time effectively does nothing. Then ensure that the actual zarr writing code will first remove the target object if it already exists. (Because these datasets that are in both zarrs and errors might or might not already exist.)

After that, do the merge.