search

Lucretius / vault_raft_snapshot_agent

⛔️ DEPRECATED ⛔️ An agent which provides periodic snapshotting capabilities of Vault's Raft backend
MIT License
78 stars 42 forks source link

Intermittent 0 byte snapshots with S3 storage #6

Closed tl-eddie-hoffman closed 3 years ago

tl-eddie-hoffman commented 3 years ago

Many thanks for creating this project.

All working well except when using the S3 bucket storage for configuration I am seeing 0 byte snapshots intermittently. Version and encryption is enabled on the bucket. I have tried disabling these but the agent continues to upload 0 byte snapshots.

image

Lucretius commented 3 years ago

Hmm, not sure what would cause this - the snapshot is generated from the Raft Snapshot API and the same snapshot is then used by all of the enabled snapshot storage methods (AWS/Azure/GCP/etc.) I wonder, have you tried enabling local file store writing as well to see if the same zero byte files get persisted to local disk? If you could try that out, and the same zero byte files were to get generated, that would indicate something is wrong with the Raft snapshot API being invoked. If not, then it would indicate something wrong with the S3 upload piece.

tl-eddie-hoffman commented 3 years ago

Couldn't get to the bottom of this, but it seems to be resolved in v0.2.1