search

spcl / faaskeeper

A fully serverless implementation of the ZooKeeper coordination protocol.
BSD 3-Clause "New" or "Revised" License
17 stars 13 forks source link

Create an offset-based counters on AWS #45

Open mcopik opened 2 months ago

mcopik commented 2 months ago

AWS implementation is based on IDs provided by SQS. These are relatively large values, which causes compatibility issues in ZooKeeper's Java client as they no longer fit into a 32-bit integer. Instead, we should process one change during deployment and store the base SQS value; we can use that to subtract counter values later and obtain counters starting from 0.

mujtaba1747 commented 1 month ago

We can deprioritize this because Hbase doesn't use these counters