Tokenizer whitespace should not match empty string. IDENTIFIER can match almost anything text strings, numbers, text.number; all these things appear before an equals sign. Include an exit clause if the tokenizer gets stuck and is not incrementing.
Print progress dots when parsing each file. It gets ugly in multithreading.
Continue on any parsing error and move to / wait for the next file.
Tokenizer whitespace should not match empty string. IDENTIFIER can match almost anything text strings, numbers, text.number; all these things appear before an equals sign. Include an exit clause if the tokenizer gets stuck and is not incrementing.
Print progress dots when parsing each file. It gets ugly in multithreading.
Continue on any parsing error and move to / wait for the next file.