search

xitongsys / parquet-go

pure golang library for reading/writing parquet file
Apache License 2.0
1.27k stars 293 forks source link

Byte Array is not working & casusing size to explode #458

Closed Lovesmoring closed 2 years ago

Lovesmoring commented 2 years ago

Hi,

I want to put binary data as one column of the parquet file, I have a 40K bytes, and when using them as string(bytes), the size explodes to over 400K, I used Snappy.

Can you help me with it? What's the correct way to put binary data using this package?

Thanks

xitongsys commented 2 years ago

parquet has some metadata which is relative big if your data is very small. Try put more data and see the results.