Source annotation archives from sandbox, staging, or public archives

m-lab / etl-gardener

Gardener provides services for maintaining and reprocessing mlab data.

Apache License 2.0

13 stars 5 forks source link

Source annotation archives from sandbox, staging, or public archives #347

Closed stephen-soltesz closed 2 years ago

stephen-soltesz commented 2 years ago

This change adds conditional source for the annotation archives to enable testing of the annotation export process.

In sandbox and staging projects, gardener will source archives from the local project, e.g. gs://archive-mlab-staging. In mlab-oti, gardener will source archives from gs://archive-measurement-lab.

This change is

stephen-soltesz commented 2 years ago

@robertodauria if this is WAI in sandbox, please feel free to merge this so that it can run in staging.

stephen-soltesz commented 2 years ago

Gardener is completing reprocessing for earlier annotation archive dates, and the annotations are appearing in sandbox tables. So I believe it is WAI in sandbox.