dynamist / subgit

Sub-git repo handler
Apache License 2.0
0 stars 0 forks source link

Implement threads or subprocesses for commands that is slow #40

Closed Grokzen closed 1 year ago

Grokzen commented 1 year ago

So i found out that when i was running subgit fetch that it was super slow even with only 3-4 repos in my config file. It would make sense to implement threads or subprocesses here to run the fetch operation in some kind of batches. Maybe a subprocess pool with 5 or 10 parralell workers is good as it would rate limit our calls to github/gitlab in the case you have some huge config files