search

lnklnklnk / ga-bq

Stream raw hit-level Google Analytics data into BigQuery
90 stars 38 forks source link

BigQuery accepts 100,000 rows per second #16

Closed fhoffa closed 7 years ago

fhoffa commented 7 years ago

Note that the project docs say: " you can not insert more than 1000 rows into bigquery at once" - but in reality BigQuery will accept upto 100,000 rows per second via streaming.

https://cloud.google.com/bigquery/quota-policy#streaminginserts

image

lnklnklnk commented 7 years ago

You're right. But there is a limit in lease_task method: https://yadi.sk/i/2BmdUAQ63LG4Rp

Fixed it in README.

Thanks you!