m-lab / etl

M-Lab ingestion pipeline
Apache License 2.0
22 stars 7 forks source link

Update annotation-service to latest #995

Closed stephen-soltesz closed 3 years ago

stephen-soltesz commented 3 years ago

This change updates m-lab/etl to use the latest version of the annotation-service repo and struct definitions.

This change will update the BQ schemas used by all datatypes to include the new annotation-service Geo and Network fields that match the fields defined by the uuid-annotator. This update is in preparation for the annotation export process after reprocessing all historical data with the new annotation-service fields.

The change to update-schema ensures that all current template tables also receive the updated schemas. Without this change the parser would stall. We could delete these tables, but would lose work-to-date.

Part of Milestone: https://docs.google.com/document/d/1seI56IGAZzfIhmkZH_Pp67fU11kynyO6mwf7gU3HeiM/edit


This change is Reviewable

coveralls commented 3 years ago

Pull Request Test Coverage Report for Build 6477


Totals Coverage Status
Change from base Build 6473: 0.0%
Covered Lines: 3572
Relevant Lines: 5640

💛 - Coveralls
stephen-soltesz commented 3 years ago

Thank you!