Closed thuyenptr closed 4 years ago
yes, if lost the checkpoint file, we lost the checkpoint.
I think maybe we can just consume the latest msg the fetch the checkpoint
.
Yeah, I think we should save the checkpoint
in Kafka instead of saving in a file. Can I make PullRequest for this?
Btw, I am implementing raft protocol for pump instance in pump cluster, can you give me some advice?
syncer.to.checkpoint
to controller how to save the checkpoint, default save at file for dest=kafka for compatibility.compatibility
mean here, can you explain it?reconcile
for accounting system
online. TiDB is HTAP database, we experimental TiDB for all transactional and analytic but the result was terrible. So we decide using TiDB-Binlog to replicate to downstream.Thank you, I will try to separate the storage layer and processing layer in pump instance first, then make availability storage
Hi,
I have a question about the checkpoint Why you don't persist checkpoint in a Topic in Kafka instead of saving checkpoint in a file (local checkpoint) (code here) I think we can lose checkpoint if drainer die.
Thank you.