Add copy and cleanup actions

m-lab / etl-gardener

Gardener provides services for maintaining and reprocessing mlab data.

Apache License 2.0

13 stars 5 forks source link

Add copy and cleanup actions #270

Closed gfr10598 closed 4 years ago

gfr10598 commented 4 years ago

This adds two more actions, to copy the deduped partition to raw_ndt, and to delete the rows from the tmp_ndt partition.

There is some code redundancy, and also opportunity for unit test improvement with bqfake. However, I think it is better to get this checked in, and do that work later. Feel free to offer opinion about how high priority those improvements should be.

This change is

coveralls commented 4 years ago

Coverage increased (+0.08%) to 61.76% when pulling 0c5a4d54d437e6020e2ceb6aa78775e59cf94491 on u-sandbox-cleanup into 8b01ef1f6185b2d74781cf63695aa5b990cd5cf0 on master.