zilliztech / milvus-backup

Backup and restore tool for Milvus
Apache License 2.0
111 stars 38 forks source link

[Bug]: The index definition is missing from the restored data. #269

Closed axiangcoding closed 6 months ago

axiangcoding commented 6 months ago

Current Behavior

when i exec command

./milvus-backup create -n my_backup
./milvus-backup restore -n my_backup -s _recover

data seems like restore as expect, however, index will missing in the xxx_recover, and xxx_recover can't load in to memory. image image As we can see, vector's index is missing and can not loaded.

Expected Behavior

xxx and xxx_recover should be exactly the same, including indexes.

Steps To Reproduce

As i describe above.

Environment

quay.io/coreos/etcd:v3.5.5
minio/minio:RELEASE.2023-03-20T20-16-18Z
milvusdb/milvus:v2.3.3
milvus-backup:v0.4.4

Anything else?

No response

axiangcoding commented 6 months ago

milvus-backup check:

root@3331df599c9c:/tools# ./milvus-backup check
0.4.4 (Built on 2023-12-12T06:34:36Z from Git SHA fca8663a31f95da7f0e6ecd1f945f4b6b7bc540a)
config:backup.yaml
[2023/12/25 08:16:57.354 +00:00] [INFO] [logutil/logutil.go:165] ["Log directory"] [configDir=]
[2023/12/25 08:16:57.357 +00:00] [INFO] [logutil/logutil.go:166] ["Set log file to "] [path=logs/backup.log]
[2023/12/25 08:16:57.400 +00:00] [INFO] [storage/minio_chunk_manager.go:131] ["minio chunk manager init success."] [bucketname=a-bucket] [root=files]
Succeed to connect to milvus and storage.
Milvus version: v2.3.3
Storage:
milvus-bucket: a-bucket
milvus-rootpath: files
backup-bucket: a-bucket
backup-rootpath: backup
axiangcoding commented 6 months ago

I just find out restore command support --restore_index flag. and this flag works fine. I recommend adding this to the example code, it helps