Poll query result if the job takes long to finish - Githubissues

sfu-db / connector-x

Fastest library to load data from DB to DataFrames in Rust and Python

https://sfu-db.github.io/connector-x

MIT License

2.02k stars 163 forks source link

Poll query result if the job takes long to finish #674

Closed x1a0 closed 3 months ago

x1a0 commented 3 months ago

Bump datafusion and arrow library to latest version
Accept BigQuery service key as JSON string
Try to cancel job when the it timed out on getting results
Use gcp-bigquery-client magnowlia-v0.20
Poll result in L1 query for fetching resultset metadata