github-actions[bot]
commented
7 months ago 
| Package | Line Rate | Branch Rate | Health |
|---|---|---|---|
| vxingest | 33% | 42% | ❌ |
| vxingest.builder_common | 29% | 17% | ❌ |
| vxingest.ctc_to_cb | 12% | 1% | ❌ |
| vxingest.grib2_to_cb | 12% | 1% | ❌ |
| vxingest.netcdf_to_cb | 13% | 1% | ❌ |
| vxingest.partial_sums_to_cb | 12% | 1% | ❌ |
| vxingest.utilities | 30% | 32% | ❌ |
| Summary | 16% (488 / 3017) | 6% (40 / 700) | ❌ |
The ingest file selection was picking up ".prev" and ".tmp" as file names and adding them to the queue. These directories are part of the ITS file transfer mechanism and should be ignored.
This PR adds a filter to the get_file_list method such that it takes the file mask parameter that is defined in the JOB document and tries to derive a timestamp from applying the mask to the basename of each selected file. Every valid files' name should reflect the mask and be able to be datetime.strptime 'd into a valid timestamp.