search

microsoft / mwt-ds

Umbrella repository for projects related to the MWT Decision Service
187 stars 77 forks source link

DataScience: Visualization and AzureStorageDownloader major improvements #106

Closed marco-rossi29 closed 6 years ago

marco-rossi29 commented 6 years ago

1) Decoupled logDownloader logic from Visualization.py. logD logic is now part of AzureStorageDownloader.py (version=1 flag) 2) Refactored cmd line parsing to avoid code duplication 3) Enabled reading Account name and key from ds.config (when pickle file doesn't exist) 4) ds.config: Removed unused settings and moved needed ones to cmd line input 5) Check that AzureStorage account_key entered has length 88 6) Using get_blob_to_path() to prevent saturating memory when downloading large files 7) Changed legends labels for Online performance and Baseline estimate 8) Cosmetic improvements

marco-rossi29 commented 6 years ago

This PR is mainly for Alekh. Its priority is low otherwise.