search

vesoft-inc / nebula

A distributed, fast open-source graph database featuring horizontal scalability and high availability
https://nebula-graph.io
Apache License 2.0
10.89k stars 1.21k forks source link

Support for Backup and Recovery for Nebula Graph Running on Kubernetes (Community Edition) #5774

Open vaibhavkgiradkar opened 1 year ago

vaibhavkgiradkar commented 1 year ago

Description: To ensure the robustness and fault-tolerance of our systems, we need to implement backup and recovery mechanisms. This feature becomes even more integral when Nebula Graph is deployed in a Kubernetes environment.

Background: Kubernetes has improved the way we deploy and scale applications, and Nebula Graph undoubtedly benefits from these advancements. However, amidst this evolution, data backup, and recovery still remains a challenge. As such, the ability to backup & restore Nebula Graph data while running on a Kubernetes environment is a fundamental requirement.

Details:

  1. Backup: This feature will allow users to create backup(s) of their entire Nebula Graph database running within a Kubernetes infrastructure. The backup may be stored in a persistent volume or cloud-based storage, depending on the user's preference.

    • The backup process should be easy to initiate (either manually or through an automated schedule).
    • The process must ensure minimal to no downtime of the nebula graph cluster itself.
    • Also, it should be able to backup all database schemas along with the user data.

  2. Recovery: Users should be able to restore their Nebula Graph database from an existing backup (originating from the same cluster or a different one).

    • Restoration process should be straightforward, minimizing any potential complexity or issues.
    • There should be some sort of version management which can then retrieve data from a particular point of time.

Additional Context: This feature will significantly enhance the reliability and resiliency of Nebula Graph deployments, ensuring data safety and ease of management for DevOps teams. It will also be beneficial for migration purposes as Kubernetes deployments can vary depending upon the cloud service providers or on-premise settings.

wey-gu commented 1 year ago

This is doable with latest operator pr, right? @MegaByte875

wey-gu commented 12 months ago

oh i realize it's not yet ready for community version of br as they were forked for now.