search

m-lab / mlab-ns-rate-limit

Rate limiting support for mlab-ns
Apache License 2.0
0 stars 0 forks source link

Run PutMulti in parallel, fix DeleteAllKeys #8

Closed gfr10598 closed 6 years ago

gfr10598 commented 6 years ago
  1. datastore.PutMulti is limited to 500 keys. This adds code to run multiple PutMulti calls in parallel.
  2. Also fixes simliar problem with DeleteAllKeys
  3. Adds timeout to BQ context. Default has timeout of 5 seconds, which is insufficient.
  4. Adds LIMIT 10000 to limit bigquery size if things get crazy. We may want to revisit this.
  5. Fixes header comments.

This change is Reviewable

pboothe commented 6 years ago

10k -> 20k + documentation