search

Azure / azure-storage-python

Microsoft Azure Storage Library for Python
https://azure-storage.readthedocs.io
MIT License
338 stars 240 forks source link

BlobStorage: Possibility of downloading a batch of blobs #554

Open casparjespersen opened 5 years ago

casparjespersen commented 5 years ago

Which service(blob, file, queue) does this issue concern?

blob

Which version of the SDK was used? Please provide the output of pip freeze.

azure-storage-blob==1.4.0 azure-storage-common==1.4.0

What problem was encountered?

I am missing the possibility of downloading/reading a batch of blobs (specifically a "folder") -- a functionality which is already present in the Azure CLI (az storage blob download-batch). I am currently using the service.get_blob_to_text(container: str, path: str), and I imagine the syntax being service.get_blobs_to_text(container: str, paths: iterable).

Have you found a mitigation/solution?

Currently I am reading the files one-by-one, which generates a performance overhead.

zezha-msft commented 5 years ago

Hi @casparjespersen, thanks for reaching out!

We already have this feature on our roadmap, but I unfortunately do not have a timeline to share yet.

dreamflasher commented 4 years ago

@zezha-msft Any progress update on this?

zezha-msft commented 4 years ago

Sorry @dreamflasher, there is no update for now, as we've been working on a new version of the SDK.

erfannariman commented 3 years ago

I created a Python wrapper for the Azure CLI to do downloads / uploads in batches, see here for more details:

Installation:

pip install azurebatchload

See the GitHub repo for usage examples.

ilayn commented 3 years ago

Other than @erfannariman 's noble attempt, is there any update for this getting support from the offical sdk?