mc2-project / mc2

A Platform for Secure Analytics and Machine Learning
Apache License 2.0
297 stars 44 forks source link

Add support for uploading entire directories to Azure blob storage #142

Open chester-leung opened 3 years ago

chester-leung commented 3 years ago

Currently, MC2 Client doesn't support uploading entire directories to Azure blob storage. We'd like to add support for this, as data encrypted in sql format is always outputted as a directory with a data sub-directory and a schema sub-directory.

To do this, we'll have to investigate how to upload/download directories to/from Azure blob storage using the Azure Python SDK, and modify the upload_data() and download_data() functions.