EnterpriseDB / barman

Barman - Backup and Recovery Manager for PostgreSQL
https://www.pgbarman.org/
GNU General Public License v3.0
2.14k stars 193 forks source link

barman-wal-archive / put-wal using (custom) compression #291

Open thoro opened 4 years ago

thoro commented 4 years ago

Hi,

I started using put-wal / barman-wal-archive and checkout out compression (https://www.endpointdev.com/blog/2017/03/28/postgres-wal-files-best-compression)

barman-wal-archive is currently not able to use any compression (via any parameter at least) and I thought for everyone using wal-archive via a internet connection this might actually be very helpful.

I envision something like in the config file, where you can put either a supported algorithm i.e. gzip or you can give the path to a custom script that executes the compression algorithm.

for example:

barman-wal-archive --compression=custom --custom_compression_filter=compress_wal.sh barman pg

The compression option should also take existing compression options: bzip2, gzip, pybzip2, pygzip, pigz

martinmarques commented 3 months ago

There are plans to improve the WAL compression. I believe this will fall in that category

martinmarques commented 2 weeks ago

Just an update here. The next release of Barman will not have compressed archiving, yet! We are working on new compression algorithms on the Barman server and at restore time. Once that is ready, and we plan on releasing those in the next release, we'll work on giving the user options for compressing before shipping the WALs to the Barman server.