feat(dl): Request Session & concurrent requests

OwenTruong / civitdl

A CLI python script to batch download models from CivitAI with CivitAI Api V1

Apache License 2.0

46 stars 6 forks source link

Closed OwenTruong closed 8 months ago

OwenTruong commented 8 months ago

Description

[x] Implement request sessions to increase performance.
[x] Limit the number of concurrent requests (max workers / threads) at a time to prevent overloading civitai.