Currently all about a months, worth is saved in the netcdf. This bug appeared when we started saving raw files to s3.
Would be good to only save the last X(say 6 hours) in the last file
Possible Implementation
Filter datetime in filename and only load ones < 6 hours
don't think it needs a separate click command - can just hard code the value (at the top of the file)
Detailed Description
Currently all about a months, worth is saved in the netcdf. This bug appeared when we started saving raw files to s3. Would be good to only save the last X(say 6 hours) in the last file
Possible Implementation
Filter datetime in filename and only load ones < 6 hours