microsoft / mwt-ds

Umbrella repository for projects related to the MWT Decision Service
187 stars 77 forks source link

Added gzip mode #223

Closed ormichae closed 3 years ago

ormichae commented 3 years ago

GZIP modes: 0 -- run evaluation on all files in oldest config folder (that falls within the specified date range) 1 -- run evaluation on one file per day from all config folders within specified date range (does not work with the multiple 250 mb files per day change) 2 -- [irrelevant] takes the cooked log line with highest reward for each event ID 3 -- (new gzip mode that I am adding) run evaluations on all files from all config folders within specified date range.

history of gzip modes: gzip mode was 1 until cooked logs were changed to have multiple 250 mb files per day (only one file per day was being processed) gzip mode was changed to 0 -- evaluations were only running on oldest configuration folder

ghost commented 3 years ago

CLA assistant check
All CLA requirements met.