search

NOAA-GFDL / CatalogBuilder

Toolset to build, validate, modify, and use intake-esm based data catalogs
2 stars 1 forks source link

30 explorecatalog #31

Closed aradhakrishnanGFDL closed 1 month ago

aradhakrishnanGFDL commented 1 month ago

addresses #30

aradhakrishnanGFDL commented 1 month ago

sample output snippet - you can run it from yours. Remove dmget lines if you don't have dmget.py in your path

(note that this catalog is an example of not an ideal case, which is why the test script is handy)

print dataset keys/names█████████████████████████████████████████| 100.00% [41/41 02:44<00:00]
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20090101-20091231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20140101-20141231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19800101-19801231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20060101-20061231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20200101-20201231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20190101-20191231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20070101-20071231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20030101-20031231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19990101-19991231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19830101-19831231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20180101-20181231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19940101-19941231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19950101-19951231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20010101-20011231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20050101-20051231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20160101-20161231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19970101-19971231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19890101-19891231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19920101-19921231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20080101-20081231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19980101-19981231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19880101-19881231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20100101-20101231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20150101-20151231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20000101-20001231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19870101-19871231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20130101-20131231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20110101-20111231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19930101-19931231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19840101-19841231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19900101-19901231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19810101-19811231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19860101-19861231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19820101-19821231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20170101-20171231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20040101-20041231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20120101-20121231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19910101-19911231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19850101-19851231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19960101-19961231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20020101-20021231
print dataset keys/names█████████████████████████████████████████| 100.00% [41/41 01:50<00:00]
---------------------
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20070101-20071231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19920101-19921231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19940101-19941231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19950101-19951231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20090101-20091231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20080101-20081231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20160101-20161231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20060101-20061231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19990101-19991231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19830101-19831231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20000101-20001231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20150101-20151231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19880101-19881231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19970101-19971231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19860101-19861231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20040101-20041231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20050101-20051231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19850101-19851231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19930101-19931231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20120101-20121231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20130101-20131231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19890101-19891231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19820101-19821231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19980101-19981231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20190101-20191231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20170101-20171231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19960101-19961231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20100101-20101231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20030101-20031231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19810101-19811231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19900101-19901231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19910101-19911231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20180101-20181231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19870101-19871231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20200101-20201231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20020101-20021231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19840101-19841231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20110101-20111231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20010101-20011231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.20140101-20141231
am5.c96L65_am5f7b10r0_amip.day.atmos_cmip.1yr.19800101-19801231
aradhakrishnanGFDL commented 1 month ago

@Ciheim please review and test as needed so this can be merged before Wednesday. Suggest changes inline as needed. thanks!

aradhakrishnanGFDL commented 1 month ago

The "scripts" directory is sort of a useful "examples" I see, more documentation than code really.

+1 it is a good addition to the docs. But, it also makes sense to have it here because the CI uses some of this (as an example of how to incorporate in MDTF or analysis-scripts) in combination with tests.