search

nestauk / daps_utils

Tools for setting up and running pipelines in a Data Analytics and Production System (DAPS).
0 stars 1 forks source link

Swap back to the metaflow security group #74

Open jaklinger opened 3 years ago

jaklinger commented 3 years ago
  1. Set up the luigi server in the metaflow security group
  2. Set up the database in the metaflow security group
  3. Swap the batch compute environment back to the metaflow security group

A subsequent issue should be raised for doing steps 1) and 2) using terraform alongside the metaflow cloudformation

jaklinger commented 3 years ago

Linked to https://github.com/nestauk/research_daps/issues/33

bishax commented 3 years ago

Moving DB and luigi server into metaflow security group seems simpler (and more secure?) than the reverse which I suggested in nestauk/research_daps#33

jaklinger commented 3 years ago

Indeed, though in practice I'll need to setup a new DB and luigi server, that's the faffy bit, but only an hours work