search

cube2222 / octosql

OctoSQL is a query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL.
Mozilla Public License 2.0
4.74k stars 201 forks source link

Parquet output format #302

Open chapmanjacobd opened 1 year ago

chapmanjacobd commented 1 year ago

It would be nice to be able to save to a binary format like Parquet or something.

There are line breaks in my data so that's causing CSV to wonk

cube2222 commented 1 year ago

Agreed adding Parquet as an output format makes sense.

Though btw. CSV should handle newlines just fine. It will just wrap the field in double-quotes.

~> echo '{"test": "value\nvalue"}' | octosql 'SELECT * FROM stdin.json' -o csv
test
"value
value"