VictoriaMetrics / vmctl

Victoria Metrics command line tool
36 stars 8 forks source link

Replication verification/enforcing #18

Open hekmon opened 4 years ago

hekmon commented 4 years ago

As of Victoria metrics v1.36.0 the long awaited replication feature is here :)

So like the planned feature "data rebalancing" planned for vmctl, I think a new one should be added: replication enforcing.

It should check a cluster for the given replication treshold and (re)create data on another nodes if needed (should it delete data too if too many of them are found ?). This would allow creating missing data for points ingested before the replication feature but also usage of vmctl as a repair tool: changing the replication level on an existing cluster for example.

johnseekins commented 4 years ago

I know the carbonate project (https://github.com/graphite-project/carbonate) does something similar for Graphite as it scales. Would some of their logic help with this?

valyala commented 3 years ago

FYI, vmctl has been migrated to main VictoriaMetrics repository. New releases for vmctl will be available at vmutils-*.tar.gz package on the releases page starting from v1.53.0 . It is recommended filing new issues and feature requests for vmctl in main VictoriaMetrics repository.

hekmon commented 3 years ago

Should I recreate the issue ? I can not see any vmctl tag tho

valyala commented 3 years ago

There is no need in recreating issues in VictoriaMetrics repository - we'll keep an eye on old issues for vmctl here.