databrickslabs / overwatch

Capture deep metrics on one or all assets within a Databricks workspace
Other
230 stars 64 forks source link

[FEAT] - Bronze Snapshots - Enable Incremental #525

Open GeekSheikh opened 2 years ago

GeekSheikh commented 2 years ago

Currently, the bronze snapshot function doesn't hanlde incremental backups.

This should be easy to implement with a Trigger.Once streaming pipeline.

Existing function

Bronze(workspace).snapshot("/path/to/my/backups/sourceFolder", true)
GeekSheikh commented 2 years ago

Simplify / Create function to restore bronze