LibreCat / Catmandu

Catmandu - a data processing toolkit
https://librecat.org
175 stars 31 forks source link

Gzip support in importers/exporters #315

Closed danmichaelo closed 7 years ago

danmichaelo commented 7 years ago

My disk would be happy if the various importers and exporters could work with gzipped files directly.

phochste commented 7 years ago

Standard input is your friend:

$ zcat large.mrc.gz | catmandu convert MARC to MARC --fix myfixes.txt " | gzip > output.gz
danmichaelo commented 7 years ago

You're right, piping works well for this, and is more in line with unix philosophy I guess :)

phochste commented 7 years ago

Yes :-) The unix eco system is so rich that you want to exploit that. Combining with grep , awk , sed , parallel , wc gives endless combinations