Update cesm2-le catalog

[mgrover1]

Update the CESM2-LE catalog to include new high frequency output and most updated datasets available on campaign

[andersy005]

@mgrover1, when you get a moment, can you resolve the conflicts?

[mgrover1]

@andersy005 the catalog is ~130 mb now... which prevents it from being uploaded

[andersy005]

@andersy005 the catalog is ~130 mb now... which prevents it from being uploaded

Can you point me to this catalog's path on Glade? I'd like to see if we can adjust compression levels

[mgrover1]

@andersy005 here are the paths! catalog json - /glade/work/mgrover/intake-esm-catalogs/glade-cesm2-le.json csv - /glade/work/mgrover/intake-esm-catalogs/glade-cesm2-le.csv.gz

[andersy005]

@mgrover1, I am confused :) Where's the 130MB file size coming from? I am seeing 44MB

$ ls -ltrh /glade/work/mgrover/intake-esm-catalogs
...
-rw-r--r-- 1 mgrover ncar  20M Sep 28 13:23 invalid_assets_cems2-le-rerun.csv.csv
-rw-r--r-- 1 mgrover ncar 5.6K Sep 28 15:11 Untitled.ipynb
-rw-r--r-- 1 mgrover ncar  59K Sep 30 08:26 invalid_assets_glade-cesm2-le.csv.csv
-rw-r--r-- 1 mgrover ncar 2.4K Sep 30 08:26 glade-cesm2-le.json
-rw-r--r-- 1 mgrover ncar 170M Oct 12 16:57 cesm2-le-revised.csv
-rw-r--r-- 1 mgrover ncar  44M Oct 12 16:58 glade-cesm2-le.csv.gz

[mgrover1]

@andersy005 when I was resolving the conflicts, it uncompressed the file...

[andersy005]

@mgrover1, I was able to resolve the conflicts and pushed to your fork's branch. Try pulling these changes and confirming that everything is working as expected.

[mgrover1]

Thanks @andersy005 ! Sorry I couldn't quite get it there.

[andersy005]

No worries... git-diffing compressed/binary files can be tedious... Resolving the conflicts wasn't straightforward. So, please confirm that I didn't actually break the catalog.

[mgrover1]

@andersy005 it works as expected 😁