So i found out that when i was running subgit fetch that it was super slow even with only 3-4 repos in my config file. It would make sense to implement threads or subprocesses here to run the fetch operation in some kind of batches. Maybe a subprocess pool with 5 or 10 parralell workers is good as it would rate limit our calls to github/gitlab in the case you have some huge config files
So i found out that when i was running
subgit fetch
that it was super slow even with only 3-4 repos in my config file. It would make sense to implement threads or subprocesses here to run the fetch operation in some kind of batches. Maybe a subprocess pool with 5 or 10 parralell workers is good as it would rate limit our calls to github/gitlab in the case you have some huge config files