I updated the paths to use the aggregation levels (like 'H' or 'D') to store data files.
I made a folder called 'daily_summaries' to store the NOAA NOS daily summary data. That way we won't overwrite it if we every switched the config file to calculate daily NOAa NOS data (which would go in the 'D' folder.
Lastly, I added a helper to utils.py to convert a local filepath to an S3 filepath so we don't have to update so many lines of code when we change our directory naming.
I updated the paths to use the aggregation levels (like 'H' or 'D') to store data files.
I made a folder called 'daily_summaries' to store the NOAA NOS daily summary data. That way we won't overwrite it if we every switched the config file to calculate daily NOAa NOS data (which would go in the 'D' folder.
Lastly, I added a helper to utils.py to convert a local filepath to an S3 filepath so we don't have to update so many lines of code when we change our directory naming.