m-lab / etl-gardener

Gardener provides services for maintaining and reprocessing mlab data.
Apache License 2.0
13 stars 5 forks source link

Change datatypes for annotation2 and hopannotation2 #420

Closed stephen-soltesz closed 1 year ago

stephen-soltesz commented 1 year ago

This change modifies the supported datatypes for the annotation2 and hopannotation2 datatypes in preparation for processing reannotated or renamed annotation archive types.

This change updates the configuration to daily_only: true for all datatypes, until the complete history of the new datatypes is available again in the public archive.

This change is part of the Correcting Network Annotations design.

This change is part of steps to repair:


This change is Reviewable

coveralls commented 1 year ago

Pull Request Test Coverage Report for Build 3627


Totals Coverage Status
Change from base Build 3619: 0.0%
Covered Lines: 1259
Relevant Lines: 1605

💛 - Coveralls
stephen-soltesz commented 1 year ago

The data is definitely ending up in the annotation2 and hopannotation2 tables. However, the annotation rate isn't stellar but I think that's due to sandbox nodes getting majority operational traffic or non-standard testing. I'll look carefully in staging.