search

gazette / core

Build platforms that flexibly mix SQL, batch, and stream processing paradigms
https://gazette.dev
MIT License
718 stars 52 forks source link

shard unassign: handle non-PRIMARY assignments which are FAILED #343

Closed jgraettinger closed 1 year ago

jgraettinger commented 1 year ago

The API should remove assignments which are non-PRIMARY but are also FAILED.

Also update gazctl to process selected shards in batches, so that each RPC is of bounded size and under the Etcd transaction size limit.

This change is Reviewable

jgraettinger commented 1 year ago

Manually tested gazctl chunking behavior by locally using smaller chunk sizes.