Closed chad-earthscope closed 5 years ago
Previous program flow: 1) Read all records from file, check headers, identifier and extra headers 1) Read all records from file (again), decompressing all data 1) Decompress each record (again) to determine payload viability
Clearly this is not optimal. There seems to have been a change in strategy from doing raw validation to doing validation using libmseed, but the work was not streamlined for this new approach.
Currently the payload checks are performed by re-reading and re-parsing the entire file being checked (in
check_file.c
), i.e. all files are read twice.This should be improved by performing the payload check for each record while it is already read into memory, in the range noted by: