This is a work in progress, but everything that has happened so far works, it just needs to be added to still.
There are now sample files for many of the models which can be used for local testing, and they are currently tested in test_process.py. Some models still need to be included: all forecast aggregations because they are currently not working, all unstructured models because I need to use code that Luke is merging sometime soon to subset the models, and all RTOFS model output because I can't seem to access the output with my setup currently.
Most of the catalog files have been modified with some rearranging and adding sample file locations which are handy to have available (sample_locs).
I also separated out the function that transforms a source (transform_source) so that I can use it more widely.
I plan to come back to these changes next week and continue working on them, but use these changes in some other work in the meantime.
This is a work in progress, but everything that has happened so far works, it just needs to be added to still.
There are now sample files for many of the models which can be used for local testing, and they are currently tested in
test_process.py. Some models still need to be included: all forecast aggregations because they are currently not working, all unstructured models because I need to use code that Luke is merging sometime soon to subset the models, and all RTOFS model output because I can't seem to access the output with my setup currently.Most of the catalog files have been modified with some rearranging and adding sample file locations which are handy to have available (
sample_locs).I also separated out the function that transforms a source (
transform_source) so that I can use it more widely.I plan to come back to these changes next week and continue working on them, but use these changes in some other work in the meantime.