Add the ability to use unix pipes instead of filenames

bryan-lott / mysqldump-to-redshift

Convert a standard mysqldump into a Redshift-importable format.

Eclipse Public License 1.0

5 stars 0 forks source link

Add the ability to use unix pipes instead of filenames #1

Open bryan-lott opened 8 years ago

bryan-lott commented 8 years ago

What is says on the tin. Add an option to be able to use pipes instead of filenames so that the script can be part of a unix pipeline. Something along the lines of: mysqldump | mysqldump-to-redshift | s3cmd put ... or mysqldump | mysqldump-to-redshift > file_to_load.tsv

bryan-lott commented 8 years ago

From everything I can tell, this should be pretty simple using *in* and *out*

reading from stdin: http://stackoverflow.com/questions/2034059/how-to-read-lines-from-stdin-in-in-clojure
writing to stdout: https://github.com/clojure-cookbook/clojure-cookbook/blob/master/04_local-io/4-01_writing-to-stdout-and-stderr.asciidoc

bryan-lott commented 8 years ago

The next question is how to do it with either stdin or a file. I think that or might do what I need it to but will need to test it.