Use AVRO format when exporting from BigQuery to Dataframe

googledatalab / pydatalab

Google Datalab Library

Apache License 2.0

194 stars 79 forks source link

Use AVRO format when exporting from BigQuery to Dataframe #11

Open gramster opened 8 years ago

gramster commented 8 years ago

See https://github.com/GoogleCloudPlatform/datalab/issues/787

Di-Ku commented 7 years ago

This needs to be considered in the context of perf issues/benchmarks. Not sure if Avro is the best solution but the referenced bug (before repos were refactored) contains important info. Assigning to Yasser per separate thread.