add configuration option to limit the number of rows per row group

segmentio / parquet-go

Go library to read/write Parquet files

https://pkg.go.dev/github.com/segmentio/parquet-go

Apache License 2.0

341 stars 58 forks source link

add configuration option to limit the number of rows per row group #394

Closed achille-roussel closed 2 years ago

achille-roussel commented 2 years ago

Fixes #375

This PR adds a new MaxRowsPerRowGroup writer option to automatically flush row groups when the configured limit of rows per row group has been reached.