digitalepidemiologylab / crowdbreaks

Crowdsourced tracking of health trends
https://www.crowdbreaks.org/
MIT License
12 stars 1 forks source link

CB-91 Fix `check_subsamples_status` looking one day behind #95

Closed utanashati closed 1 year ago

utanashati commented 1 year ago

Fixes #91

What I did here was a bit different than I intended, but it makes the whole process of creating new automatic MTurk and local batches way easier.

The code works the following way:

  1. Retrieve the times when check_samples_status/check_subsamples_status were last run (using the created_at attribute).
    • Add S3 filenames of sample & subsample to MturkAutoBatch for further reference.
  2. Parse datetimes from the samples/subsamples file paths.
  3. Only update samples/subsamples that were changed after the time when check_samples_status/check_subsamples_status were last run.

Created a new issue (digitalepidemiologylab/crowdbreaks-streamer#27) to update this in the streamer repo.

bkDJ commented 1 year ago

Thank you! I added a spec file, and we can go over this tomorrow :)