search

m-lab / etl-gardener

Gardener provides services for maintaining and reprocessing mlab data.
Apache License 2.0
13 stars 5 forks source link

Add ndt5 support and configuration #366

Closed stephen-soltesz closed 2 years ago

stephen-soltesz commented 2 years ago

This change adds support to the gardener v2 system for processing ndt5 results and joining them with standard uuid-annotations.

This change depends on https://github.com/m-lab/etl/pull/1045

During deployment, the v1 gardener configuration for ndt5 must be manually deleted from the data-processing-cluster in mlab-staging and mlab-oti.

Once deployed the public unified tables for ndt will not have current ndt5 data until the underlying extended views are updated to reference these new standard column tables.

This change is Reviewable

coveralls commented 2 years ago

Coverage Status

Coverage decreased (-0.04%) to 61.106% when pulling d968f833cee997529c3238c70b4caac48e9059e3 on sandbox-soltesz-ndt5-config into a05178874dda507f779055ddf6678341c92ddd6f on master.

stephen-soltesz commented 2 years ago

Part of: