manojkarthick / pqrs

Command line tool for inspecting Parquet files
Apache License 2.0
294 stars 29 forks source link

Silence non-row output in `pqrs cat` #20

Closed juan-riveros closed 2 years ago

juan-riveros commented 2 years ago

I have to convert formats from time to time and being able to just pipe the outputs is super helpful.

Unfortunately having the extra 6 lines means having a (slightly) more complicated command which is harder to share among my team.

pqrs cat -j foo.parquet | tail -n +6 |jq -c . - | gzip -c > foo.ndjson.gz

Adding a --quiet/-q flag to mute any non-data output would be neat, or possibly just moving that type of output to stderr instead (ie. changing lines 110-112 from println! to eprintln)?

juan-riveros commented 2 years ago

Oops, put the PR to the wrong repo. Anyways, it's a simple fix if the quiet flag is just not something you want to deal with.