:zap: Import each table concurrently

AndreasSko / go-jwlm

A command line tool to easily merge JW Library backups, written in Go.

MIT License

71 stars 4 forks source link

:zap: Import each table concurrently #75

Closed AndreasSko closed 3 years ago

AndreasSko commented 3 years ago

As for the imports there are no interdependencies that would require serial importing, we can run each import per table "at the same time". In my testing, this resulted in a 3x speed up of importing for each 3MB backup (60ms vs 180ms!).

coveralls commented 3 years ago

Coverage decreased (-0.4%) to 85.837% when pulling be3da27fddccd29052831892f91ee2adde1ce821 on concurrent_import into da487054a8afc77861278e263d2cd8969d7c2b35 on master.