I am trying to use intake_esm as our main catalog handling tool for a large collections of datasets at my climate service provider servers. Because of the huge number of individual assets (files), I thought it would make more sense to divide the catalog in thematic sub-catalogs. But what if someones wants a catalog that includes data from two or more of these "thematics"?
My question is would there be a way to optionally make "catalog_file" a list of paths?
I currently have a custom function that concats the pandas Dataframe in-memory and then initializes the catalog. That option could also be implemented only in intake_esm if folks there agree. But, I felt asking the question here first made most sense.
I am trying to use
intake_esmas our main catalog handling tool for a large collections of datasets at my climate service provider servers. Because of the huge number of individual assets (files), I thought it would make more sense to divide the catalog in thematic sub-catalogs. But what if someones wants a catalog that includes data from two or more of these "thematics"?My question is would there be a way to optionally make "catalog_file" a list of paths?
I currently have a custom function that concats the pandas Dataframe in-memory and then initializes the catalog. That option could also be implemented only in
intake_esmif folks there agree. But, I felt asking the question here first made most sense.