zilliztech / milvus-backup

Backup and restore tool for Milvus
Apache License 2.0
135 stars 50 forks source link

Effect of backup on currently indexing collection #464

Open nisharyan opened 2 days ago

nisharyan commented 2 days ago

Documentation Link

No response

Describe the problem

The documentation says

The Milvus-backup process has negligible impact on the performance of Milvus. Milvus cluster is fully functional and can operate normally while backup and restoration are in progress.

Need further clarification on how the in-progress indexing data is handled? There are two use-cases I can think of:

Does it backup this data as well? How does the backup tool handle these scenarios?

Describe the improvement

No response

Anything else?

No response

zhuwenxing commented 2 days ago

A new collection is created and being indexed during the backup

During backup, the backup tool does not back up indexes. Indexes are rebuilt during recovery.

Updates are made to an existing collection during backup

When the backup is triggered, there will be a current timestamp (ts). Only data before this ts will be backed up.