github-tooling / ghtopdep

:star: CLI tool for sorting dependents repo by stars
MIT License
261 stars 18 forks source link

Switch to asynchronous getting #17

Closed nnewram closed 1 year ago

nnewram commented 3 years ago

The program runs extremely slow for repositories which have a large amount of dependents. To resolve this, using an asynchronous library instead of normal requests would be preferred as most runtime is spent waiting for tcp.

Dobatymo commented 1 year ago

I think that's not possible. Because you need the current page to figure out the URL of the next one. It's not as simple as downloading ?page=1, ?page=2 and so on in parallel. Blame Github for not providing a better interface.