I'm currently developing an intake-ESM catalog for the ct11 collection, and I've come across duplicate files in the /g/data/ct11/access-nri/replicas/esmvaltool/obsdata-v2/Tier1 folder. After a detailed review, I identified a total of 1,306 duplicate files, which collectively take up about 4.8 GB of disk space.
I'm currently developing an intake-ESM catalog for the ct11 collection, and I've come across duplicate files in the /g/data/ct11/access-nri/replicas/esmvaltool/obsdata-v2/Tier1 folder. After a detailed review, I identified a total of 1,306 duplicate files, which collectively take up about 4.8 GB of disk space.