Azure / azure-storage-cpplite

Lite version of C++ Client Library for Microsoft Azure Storage
MIT License
25 stars 43 forks source link

Dowload performance is slow when downloading 10 K packages #118

Open Gaurav-Karu opened 3 years ago

Gaurav-Karu commented 3 years ago

@Jinming-Hu

I have used blob_client and blob_wrap api for Downloading 10000+ Packages and found some issues.

BlobClient download_blob_to_stream BlobWrap download_blob_to_file I set the concurrencylimit as 16, But I noticed that at one point if we used download_blob_to_stream, the Download becomes very slow, and if we go with the download_blob_to_file where CPU usages increased and make the Gateway slow. And the slowness I observed after downloading the 1000 packages after that it becomes slow. Can you please suggest the way to use this effetively and also suggest How we can improve the performance .