replicase / pgcapture

A scalable Netflix DBLog implementation for PostgreSQL
Apache License 2.0
220 stars 31 forks source link

feat: use acking instead of seeking for pulsar sub tracker #25

Closed benjamin99 closed 1 year ago

benjamin99 commented 1 year ago

Description

Since the replicated snapshots updates only triggered by the ack events, the PR adjusted the commit behavoid of the pulsar sub tracker (from seeking to acking) for allowing the tracker cursor to be albe to replicate to the remote clusters.

What was done:

  1. updated the pulsar sub trackers.
  2. upgraded the pulsar-go-client to v0.10.0 (since the AckIDCumulative is not supported before v0.10.0).
  3. replaced the streamnative/pulsarctl with the streamnative/pulsar-admin-go (since it looks like the streamnative are now migrating the admin client implementations to the pulsar-admin-go package).
  4. upgraded go to 1.20.

Related Document

https://github.com/apache/pulsar/wiki/PIP-33:-Replicated-subscriptions#proposed-solution