microsoft / mwt-ds

Umbrella repository for projects related to the MWT Decision Service
187 stars 77 forks source link

Parallelization and better date filtering #87

Closed GalOshri closed 7 years ago

GalOshri commented 7 years ago

Parallelization: download joined logs and models using parallel threads Date filtering: instead of looking through all blobs and only downloading the blobs in the correct date range, look through only blobs in the correct date range.

Note: using "if name == 'main':" to avoid multithreading issues.

eisber commented 7 years ago

thanks!