m-lab / etl

M-Lab ingestion pipeline
Apache License 2.0
22 stars 7 forks source link

Migrate remaining v1 datatypes to the v2 data pipeline #1096

Open stephen-soltesz opened 2 years ago

stephen-soltesz commented 2 years ago

To conserve engineering effort we elected to discontinue work on the v1 datatypes that were not generating new data.

After removing most v1 logic, the v1 parser logic remains with their v1 schemas.

Ultimately, these v1 types should be migrated to the v2 data pipeline.

Synthetic UUID export should be performed on the static tables for these types at the same time to preserve historical geographic annotations.