mjakubowski84 / parquet4s

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.
https://mjakubowski84.github.io/parquet4s/
MIT License
283 stars 65 forks source link

add support for scalapb #305

Closed huajiang-tubi closed 1 year ago

huajiang-tubi commented 1 year ago

This PR adds a module (parquet4s-scalapb) to support read/write GeneratedMessages by scalapb. It's compatible with parquet-protobuf - files written with parquet-protobuf configured with parquet.proto.writeSpecCompaliant = true can be read with parquet4s-scalapb, and files written with parquet4s-scalapb should also be readable by parquet-protobuf as long as there's no scala only features involved.