In read_files.py, there's a try/except outside of the main read loop (line 88), but not within the loop itself (line 120). This means that if read_files.py encounters a bad file within the loop, it throws out all of the files within that batch instead of just the one.
Expected Behavior
The script should fail to an except within the loop, which results in only the one bad file being discarded.
Describe the Problem
In read_files.py, there's a try/except outside of the main read loop (line 88), but not within the loop itself (line 120). This means that if read_files.py encounters a bad file within the loop, it throws out all of the files within that batch instead of just the one.
Expected Behavior
The script should fail to an except within the loop, which results in only the one bad file being discarded.