search

sibblegp / b2blaze

b2blaze
MIT License
609 stars 31 forks source link

_update_files_list stalls uploading on any bucket with > 1k files #31

Open kaivi opened 5 years ago

kaivi commented 5 years ago

What is the point of retrieving a complete file list right after a successful upload? It is this line here.

With a bucket of 500k files, the lib goes through all of them 1k at a time:

image
WardPearce commented 4 years ago

Hey, might be worth checking out my backblaze b2 wrapper. I don't believe it has this issue.

https://pypi.org/project/backblaze/ https://backblaze.readthedocs.io/en/latest/index.html https://github.com/WardPearce/backblaze