m-lab / etl-gardener

Gardener provides services for maintaining and reprocessing mlab data.
Apache License 2.0
13 stars 5 forks source link

Additional BQ steps #259

Open gfr10598 opened 4 years ago

gfr10598 commented 4 years ago
  1. Copy any missing rows from raw_ndt to tmp_ndt??
  2. Copy table from tmp_ndt to raw_ndt after dedup.
  3. Delete tmp_ndt partition after copy.
  4. Delete tmp_ndt partition on error cleanup or on init? // If we delete partition on init, we have to delay the response to the parser.