pitt-crc / lmod_tracking

Database ingestion for Lmod usage logs
https://crc-pages.pitt.edu/lmod_tracking/
GNU General Public License v3.0
0 stars 0 forks source link

Add support for partial file parsing #55

Open djperrefort opened 9 months ago

djperrefort commented 9 months ago

Log files are currently parsed as columnar data. This means if a single log record is miss formatted (or has some other strange error) the entire file will fail to parse. I would like to switch to row based parsing where unparsable log entries are skipped with a warning.