Closed randytpierce closed 7 months ago
This error happened because the python globbing that we were using in the file selection started returning entries that start with '.'. It seems that they didn't used to do that. I added additional filtering in the fet_file_list method to qualify the file names by their pattern. Their pattern is a date format string that defines how the filenames are mapped to timestamps. This is fixed in branch '313-seeing-errors-in-metar-netcdf-ingest-processing'
I am seeing errors like this...
in obs processing sometimes. Notice the "Exception with builder build_document: file_name: /public/data/madis/point/metar/netcdf/.prev" It seems to think it needs to process a file named ".prev"