Investigate possibility to support Parquet

spring-projects / spring-batch-extensions

Spring Batch Extensions

242 stars 258 forks source link

Investigate possibility to support Parquet #70

Open dgray16 opened 3 years ago

dgray16 commented 3 years ago

https://hadoop.apache.org/ https://cloud.google.com/bigquery/docs/loading-data-cloud-storage-parquet https://cloud.google.com/bigquery/docs/exporting-data#parquet_export_details

mminella commented 3 years ago

Spring had a Spring for Apache Hadoop module that was built upon Spring Batch. I don't think we should revive that kind of functionality here. If there is interest in that project still, you should take it up with that project: https://spring.io/projects/spring-hadoop

dgray16 commented 3 years ago

@mminella thanks for the update, but this issue is created to investigate possibility to add support of Parquet data type for BigQuery Spring Batch module. Will change topic name to make it more clear.