Metadata log clean up and alert

zettadb / cluster_mgr

Clust_mgr is an important compnent of KunlunBase. It provides a HTTP API for KunlunBase users to do cluster management, provisioning and monitor work, so that uses can install a cluster, a kunlun-server node, a storage shard or a kunlun-storage node by calling such APIs. Such capability enables users to integrate KunlunBase management and provisioning as part of their existing application or GUIs. Cluster_mgr also provide other important cluster maintenance background work to make sure the KunlunBase clusters it serves can work efficiently and reliably.

http://www.kunlunbase.com

Apache License 2.0

10 stars 2 forks source link

Metadata log clean up and alert #65

Open jd-zhang opened 2 years ago

jd-zhang commented 2 years ago

Issue migrated from trac ticket # 586 www.kunlunbase.com

component: cluster manager | priority: major

2022-04-18 11:28:29: zhaowei@zettadb.com created the issue

clean up commit_log and ddl log periodically, and warn if not cleaned for too long.

if a txn is externally prepared, it's commit log can't be cleaned.

if a cluster KC's latest computing node backup is CN1, KC's ddl logs before CN1.pg_ddl_log_progress.myid can be cleaned.