m-lab / etl-gardener

Gardener provides services for maintaining and reprocessing mlab data.
Apache License 2.0
13 stars 5 forks source link

Source hopannotation1 archives from sandbox, staging, or public archives #357

Closed cristinaleonr closed 2 years ago

cristinaleonr commented 2 years ago

Get hopannotation1 archive from the ANNOTATION_SOURCE_PROJECT variable.

The same change was done for the annotation data type https://github.com/m-lab/etl-gardener/pull/347.

We can observe that synthetic data (e.g., before August 2021) is being parsed and written out to the bucket&project=mlab-sandbox&prefix=&forceOnObjectsSortingFiltering=false) in sandbox.

This change is Reviewable

coveralls commented 2 years ago

Coverage Status

Coverage remained the same at 60.44% when pulling 454e45ab70fd9dc94b579449cdc6d7c4aab56b13 on sandbox-cristinaleon-bucket-config into 3bd6e68f160ad4ab730088ceb3801c4813873f04 on master.

SaiedKazemi commented 2 years ago
:lgtm: