Apply data protection rules for Azure container

OCHA-DAP / hdx-signals

HDX Signals

https://un-ocha-centre-for-humanitarian.gitbook.io/hdx-signals/

GNU General Public License v3.0

5 stars 0 forks source link

Apply data protection rules for Azure container #91

Closed hannahker closed 2 months ago

hannahker commented 3 months ago

[x] Soft delete for blobs
[ ] Versioning for blobs

See: https://learn.microsoft.com/en-us/azure/storage/blobs/versioning-enable?tabs=portal

I have access through the UI for soft delete, but not for versioning. @caldwellst do you know who we reach out to for this?

caldwellst commented 3 months ago

It would be Saeid again!

caldwellst commented 3 months ago

How's this going?

hannahker commented 3 months ago

@caldwellst soft delete is enabled with 7 days recovery. Apparently the type of storage account we have (Delta Lake Storage) does not allow blob versioning... I can look into this further and see if there are any options to change this.

caldwellst commented 3 months ago

Okay weird! If not, we could maybe setup manual copying on the overall file to another folder every time we are going to overwrite?

hannahker commented 2 months ago

Done. Blob versioning is not supported for our container type (Delta Lake). See #193 for next steps.