leverages the previously built 'rich' integration,
exposes several types of progress bar,
provides a contextmanager method for wrapping work with progress bars,
progress updates are asynchronous so they don't slow down processing so much,
integrates the progress bars with cache building and downloads,
some perf tweaks to Station imports,
some perf tweaks to eddblink prices imports (may need further tuning),
calling self.tdenv.DEBUGX adds up to about ~2s of processing time when importing prices, because of python call overhead so I put it behind a conditional,
fixed some linting and other minor issues,
minor tidy up
add StationDemand and StationSupply tables for future use
an initial test importing to these tables instead of StationItem reduced clean EDDB import from ~30 minutes to 5.
Suggest you try running this a few times to decide if you like how the bars look, where they're used, etc.
Once this is landed, I'm going to finish off changes to eddblink that reduces the time it takes to collect all the "is this file out of date?" by doing them over a single HTTPS connection.
kfsone
commented
1 month ago
Suggest you try running this a few times to decide if you like how the bars look, where they're used, etc.
Once this is landed, I'm going to finish off changes to eddblink that reduces the time it takes to collect all the "is this file out of date?" by doing them over a single HTTPS connection.