alphagov / cyber-security-windows-sandbox

Build a windows domain in AWS with terraform with a DC and WEC event forwarding.
MIT License
3 stars 0 forks source link

Figure out how to handle a failed pipeline run^ #37

Closed danjoneslf closed 3 years ago

danjoneslf commented 3 years ago

At the moment if the pipeline stops then the sandbox doesn't get destroyed. If the sandbox doesn't get destroyed then a) it's costing us money b) it's an unmaintained windows server and c) the next time you run the pipeline it i) creates a new keypair and updates secrets manager to overwrite the current values ii) then does an apply over the existing deployed TF which doesn't do anything iii) fails the smoke test because the events were created too long ago iv) fails to decode the Administrator password with the new data and overwrites it in SSM with "missing"

Basically once that's happened you have to manually run a destroy to recover it.

danjoneslf commented 3 years ago

This will be fixed by splunk-apps PR 675.

danjoneslf commented 3 years ago

This is resolved by the above Splunk apps PR.