Add zstd compression support to Barman Cloud

EnterpriseDB / barman

Barman - Backup and Recovery Manager for PostgreSQL

https://www.pgbarman.org/

GNU General Public License v3.0

2.06k stars 191 forks source link

Open Jellyfrog opened 7 months ago

Jellyfrog commented 7 months ago

This implements zstandard support to Barman cloud

Quick benchmark (from my laptop over internet to S3) shows it's the fastest and second smallest size:	Type	Size
bz2	187.7 MB	81,26s
gz	250.5 MB	137,36s
snappy	398.1 MB	8,41s
tar	945.9 MB	9,05s
zstd	242.2 MB	8,24s

Fixes #850

Jellyfrog commented 7 months ago

~I'll leave this in draft until I tested it more~

Tested backup and restore with basebackup and Wal files.

Jellyfrog commented 7 months ago

Ping @martinmarques

martinmarques commented 7 months ago

Ping @martinmarques

A little patience, we have some deadlines with products, but this is on our radar and we do want to fully analyse this with the CNPG team.

More later.