tcgoetz / GarminDB

Download and parse data from Garmin Connect or a Garmin watch, FitBit CSV, and MS Health CSV files into and analyze data in Sqlite serverless databases with Jupyter notebooks.
GNU General Public License v2.0
1.1k stars 138 forks source link

Feature request: Multi-threading or multi-processing for --import and --analyze commands #222

Open shemeshg opened 7 months ago

shemeshg commented 7 months ago

Is your feature request related to a problem? Please describe.

run the --import and --analyze commands on GarminDB, take too long to complete, even for just --latest option.

Describe the solution you’d like

I would like the --import and --analyze commands to be multi-threaded or multi-processed, so that they can utilize the available CPU cores and speed up the execution. This would make GarminDB more efficient and responsive, and save me time

Describe alternatives you’ve considered

N/A

Additional context

the commands only use one CPU core and take several minutes to finish. I think this can be improved by implementing multi-threading or multi-processing.