These files should have the names pending-files-[timestamp].csv and pending-errors-[timestamp].csv respectively, where timestamp is the same between both. The function that creates these files takes a timestamp as a parameter to reflect this. However, in the current implementation, the two files are not created at the same time.
This suggests that it would be a good idea to instantiate the timestamp variable outside of both checked and raw data processing, and then pass it as a parameter of the functions that handle each part of the pipeline.
These files should have the names
pending-files-[timestamp].csv
andpending-errors-[timestamp].csv
respectively, wheretimestamp
is the same between both. The function that creates these files takes a timestamp as a parameter to reflect this. However, in the current implementation, the two files are not created at the same time.This suggests that it would be a good idea to instantiate the timestamp variable outside of both checked and raw data processing, and then pass it as a parameter of the functions that handle each part of the pipeline.