segmentio / parquet-go

Go library to read/write Parquet files
https://pkg.go.dev/github.com/segmentio/parquet-go
Apache License 2.0
341 stars 102 forks source link

bigdata is slow #480

Open zqlpaopao opened 1 year ago

zqlpaopao commented 1 year ago

The main advantage of parquest is data compression. The purpose of data compression is to convert a large amount of data into small storage. Using parquest to read or write files are large files. At present, the file compression used is about 800m, but the reading time is more than two hours, which is too slow