search

yugabyte / yugabyte-db

YugabyteDB - the cloud native distributed SQL database for mission-critical applications.
https://www.yugabyte.com
Other
8.99k stars 1.07k forks source link

[Platform] YW upgrade failed after enable encryption at rest task for a universe failed #6535

Open rao-vasireddy opened 3 years ago

rao-vasireddy commented 3 years ago

This was on 2.0.5.7

In the past it appeared that they tried to enable encryption at rest on the only universe on this YW and that failed. That seems to have left YW metadata in a bad state. universe_details_json had a keyvalue pair "encryptionAtRestConfig":null and there was data in the two kms tables as if encyption at rest was enabled for this universe.

We probably need to do two things when the Enable encryption at rest task fails.

  1. Do not update the universe details json with the above key value pair
  2. roll back the kms table entry (do we need to rollback only the entry in the kms history table?)
daniel-yb commented 3 years ago

This issue is most likely isolated to older versions of YW (pre 2.1). Will dig into it some more to confirm my hunch though.