MeltanoLabs / target-athena

Singer.io Target for AWS Athena.
Other
5 stars 16 forks source link

Add support for Parquet format #9

Open andrewcstewart opened 3 years ago

andrewcstewart commented 3 years ago

Parquet is likely the preferred format to use in many Athena applications.

Examples

yummydum commented 2 years ago

Adding something like this to formats.py should work

import pyarrow as pa
pa.parquet.write_table(pa.Table.from_pydict(record),filename)