search

EnterpriseDB / barman

Barman - Backup and Recovery Manager for PostgreSQL
https://www.pgbarman.org/
GNU General Public License v3.0
2.14k stars 193 forks source link

Allow barman cloud upload limits to be specified when using s3-compatible object stores #767

Open mikewallace1979 opened 1 year ago

mikewallace1979 commented 1 year ago

An object store can be compatible with the S3 API but have different constraints, e.g. the maximum upload size and maximum number of parts allowed can be different.

Barman cloud should allow these to be specified in addition to the existing --max-archive-size parameter.

https://github.com/cloudnative-pg/cloudnative-pg/issues/1673

rdegez commented 2 months ago

Hi!

Any chance this goes into the next barman release ?

This limitation forbid the use of CNPG with Scaleway (major french/european cloud-provider) object-storage that only allow up-to 1000 chunks per MultilPartUpload.

Cheers

rdegez commented 2 months ago

Hi!

Any chance this goes into the next barman release ?

This limitation forbid the use of CNPG with Scaleway (major french/european cloud-provider) object-storage that only allow up-to 1000 chunks per MultilPartUpload.

Cheers

Ok, that's not entirely true :-)

By adding this setting to the CNPG cluster custom ressource, we can now upload backup up to 100GB which fir our need for now.

additionalCommandArgs:
            - --min-chunk-size=104857600