Importing large file of many messages into queues takes a very long time.

microsoft / AzureStorageExplorer

Easily manage the contents of your storage account with Azure Storage Explorer. Upload, download, and manage blobs, files, queues, tables, and Cosmos DB entities. Gain easy access to manage your virtual machine disks. Work with either Azure Resource Manager or classic storage accounts, plus manage and configure cross-origin resource sharing (CORS) rules.

Creative Commons Attribution 4.0 International

372 stars 85 forks source link

Importing large file of many messages into queues takes a very long time. #8099

Open damienwebdev opened 1 month ago

damienwebdev commented 1 month ago

Preflight Checklist

[X] I have installed the latest version of Storage Explorer.
[X] I have checked existing resources, including the troubleshooting guide and the release notes.
[X] I have searched for similar issues.

Problem

I'm importing a file of 360,000 messages (10 character strings) into a queue and it's projected to take 7.5 hours.

Desired Solution

I would like for this to take at most 30 minutes.

Alternatives and Workarounds

No response

Additional Context

No response

craxal commented 1 month ago

@RichardMSFT Can you investigate this for 1.36.0, do some performance testing? I would expect sending roughly 360,000 network requests could take a while, but not several hours.