danthegoodman1 / UltraQueue

Distributed pull queue based on Segment's Centrifuge. Zero dependency p2p clustering.
GNU Affero General Public License v3.0
1 stars 0 forks source link

Partition draining #32

Closed danthegoodman1 closed 2 years ago

danthegoodman1 commented 2 years ago

Capabilities to drain a partition on graceful shutdown as specified in the design docs

The internal grpc interface will also need an inbound drain rpc to efficiently handle bulk loading.

The TaskDB interface will also need a way to batch insert payloads and states during inbound drain so we can return a single write result for the batch of payload and batch of state puts.