Open li904775857 opened 8 months ago
fuzzyzz
commented
7 months ago Faced the same problem. I backup data from a standalone milvus which deployed by docker compose, and restore these data into another standalone milvus instance which deployed by helm in a k8s cluster. Only collections been created, every collection is empty. By the way, the backup tool even said that the restore process succeed, emm…… I don't know what happened.
IshanFernandoClouda
commented
7 months ago make sure that the bucket names are correct
axiangcoding
commented
6 months ago Same issue here. I try to backup some collecltion from one milvus to another mivlus but failed because of missing data and missing indexes. However, collection was created successfully.
IshanFernandoClouda
commented
6 months ago what is the output of ./milvus-backup check command
divyajaincs
commented
1 month ago Same issue facing with Milvus 2.3.3, not even collection created when i'm taking the restore, but it showing that backup and restore is done successfully.
divyajaincs
commented
1 month ago what is the output of
./milvus-backup checkcommand
getting the proper result of this
Current Behavior
edition milvus cluster : 2.2.31 milvus-backup: 0.3.3
Cluster deployment k8s
describe The pulsar-bookie-ledgers-milvusdata-pulsar-bookie log was deleted
data There are 1 million data in the collection to be backed up
logs [GIN] 2023/10/26 - 19:30:40 | 200 | 9.666623ms | 10.10.10.3 | POST "/api/v1/create" [2023/10/26 19:30:40.207 +08:00] [INFO] [core/backup_impl_create_backup.go:248] ["collections to backup"] [collections="[chinese_embedding_flag]"] [2023/10/26 19:30:40.227 +08:00] [INFO] [core/backup_impl_create_backup.go:285] ["try to get index"] [collection_name=chinese_embedding_flag] [2023/10/26 19:30:40.263 +08:00] [INFO] [core/backup_impl_create_backup.go:305] ["field index"] [collection_name=chinese_embedding_flag] [field_name=only_id] ["index info"="[{}]"] [2023/10/26 19:30:40.287 +08:00] [INFO] [core/backup_impl_create_backup.go:305] ["field index"] [collection_name=chinese_embedding_flag] [field_name=embedding] ["index info"="[{}]"] [2023/10/26 19:30:40.311 +08:00] [INFO] [core/backup_impl_create_backup.go:398] ["GetPersistentSegmentInfo before flush from milvus"] [collectionName=chinese_embedding_flag] [segmentNumBeforeFlush=0] [2023/10/26 19:30:41.136 +08:00] [INFO] [core/backup_impl_create_backup.go:407] ["flush segments"] [collectionName=chinese_embedding_flag] [newSealedSegmentIDs="[445157764551563229]"] [flushedSegmentIDs="[]"] [timeOfSeal=1698319840] [2023/10/26 19:30:41.141 +08:00] [INFO] [core/backup_impl_create_backup.go:420] ["GetPersistentSegmentInfo after flush from milvus"] [collectionName=chinese_embedding_flag] [segmentNumBeforeFlush=0] [segmentNumAfterFlush=1] [2023/10/26 19:30:41.141 +08:00] [INFO] [core/backup_impl_create_backup.go:457] ["Finished fill segment"] [collectionName=chinese_embedding_flag] [2023/10/26 19:30:41.153 +08:00] [WARN] [core/backup_impl_create_backup.go:468] ["this segment has no insert binlog"] [id=445157764551563229] [2023/10/26 19:30:41.153 +08:00] [INFO] [core/backup_impl_create_backup.go:474] ["readSegmentInfo from storage"] [collectionName=chinese_embedding_flag] [segmentNum=1] [2023/10/26 19:30:41.153 +08:00] [INFO] [core/backup_impl_create_backup.go:506] ["finish build partition info"] [collectionName=chinese_embedding_flag] [partitionNum=1] [2023/10/26 19:30:41.153 +08:00] [INFO] [core/backup_impl_create_backup.go:510] ["Begin copy data"] [collectionName=chinese_embedding_flag] [segmentNum=1] [2023/10/26 19:30:41.153 +08:00] [INFO] [core/backup_impl_create_backup.go:540] ["partition size is smaller than MaxSegmentGroupSize, won't separate segments into groups in backup files"] [collectionId=445157764551563151] [partitionId=445157764551563152] [partitionSize=0] [MaxSegmentGroupSize=2147483648] [2023/10/26 19:30:41.282 +08:00] [INFO] [core/backup_impl_create_backup.go:579] ["finish executeCreateBackup"] [requestId=17658440-73f3-11ee-b6d7-0050569dbeb3] [backupName=chinese_embedding_flag] [collections="[chinese_embedding_flag]"] [async=true] ["backup meta"="{\"id\":\"17658440-73f3-11ee-b6d7-0050569dbeb3\",\"state_code\":2,\"start_time\":1698319840193,\"end_time\":1698319841153,\"name\":\"chinese_embedding_flag\",\"backup_timestamp\":1698319840193,\"size\":0,\"milvus_version\":\"v2.2.13\"}"] [2023/10/26 19:31:24.387 +08:00] [INFO] [core/backup_impl_restore_backup.go:25] ["receive RestoreBackupRequest"] [requestId=31be5ad3-73f3-11ee-b6d7-0050569dbeb3] [backupName=chinese_embedding_flag] [collections="[chinese_embedding_flag]"] [CollectionSuffix=_bak] [CollectionRenames=null] [async=true] [bucketName=] [path=] [databaseCollections=] [2023/10/26 19:31:24.387 +08:00] [INFO] [core/backup_context.go:183] ["receive GetBackupRequest"] [requestId=31be621c-73f3-11ee-b6d7-0050569dbeb3] [backupName=chinese_embedding_flag] [backupId=] [bucketName=] [path=] [2023/10/26 19:31:24.387 +08:00] [INFO] [core/backup_context.go:248] ["finish GetBackupRequest"] [requestId=31be621c-73f3-11ee-b6d7-0050569dbeb3] [backupName=chinese_embedding_flag] [backupId=] [bucketName=] [path=] [resp="requestId:\"31be621c-73f3-11ee-b6d7-0050569dbeb3\" msg:\"success\" data:<id:\"17658440-73f3-11ee-b6d7-0050569dbeb3\" state_code:BACKUP_SUCCESS start_time:1698319840193 end_time:1698319841153 name:\"chinese_embedding_flag\" backup_timestamp:1698319840193 collection_backups:<id:\"17754539-73f3-11ee-b6d7-0050569dbeb3\" start_time:1698319840 collection_id:445157764551563151 db_name:\"default\" collection_name:\"chinese_embedding_flag\" schema:<name:\"chinese_embedding_flag\" description:\"bge-large-zh\346\250\241\345\236\213\350\275\254\347\232\204\345\220\221\351\207\217\" fields:<fieldID:100 name:\"only_id\" is_primary_key:true data_type:VarChar type_params:<key:\"max_length\" value:\"100\" > > fields:<fieldID:101 name:\"embedding\" data_type:FloatVector type_params:<key:\"dim\" value:\"1024\" > > > shards_num:1 consistency_level:Bounded partition_backups:<partition_id:445157764551563152 partition_name:\"_default\" collection_id:445157764551563151 segment_backups:<segment_id:445157764551563229 collection_id:445157764551563151 partition_id:445157764551563152 num_of_rows:12202 deltalogs:<> > load_state:\"NotLoad\" > backup_timestamp:445204356136960 has_index:true index_infos:<field_name:\"embedding\" index_name:\"_default_idx_101\" index_type:\"HNSW\" params:<key:\"index_type\" value:\"HNSW\" > params:<key:\"metric_type\" value:\"IP\" > params:<key:\"params\" value:\"{\\"M\\": 64, \\"efConstruction\\": 256}\" > > load_state:\"NotLoad\" backup_physical_timestamp:1698319840 > milvus_version:\"v2.2.13\" > "] [2023/10/26 19:31:24.387 +08:00] [INFO] [core/backup_impl_restore_backup.go:164] ["Collections to restore"] [collection_num=1] [GIN] 2023/10/26 - 19:31:24 | 200 | 14.395878ms | 10.10.10.3 | POST "/api/v1/restore" [2023/10/26 19:31:24.399 +08:00] [INFO] [core/backup_impl_restore_backup.go:314] ["executeRestoreBackupTask start"] [backup_name=chinese_embedding_flag] [backupBucketName=a-bucket] [backupPath=backup/chinese_embedding_flag] [2023/10/26 19:31:24.399 +08:00] [INFO] [core/backup_impl_restore_backup.go:357] ["start restore"] [db_name=default] [collection_name=chinese_embedding_flag_bak] [backupBucketName=a-bucket] [backupPath=backup/chinese_embedding_flag] [2023/10/26 19:31:24.399 +08:00] [INFO] [core/backup_impl_restore_backup.go:383] ["collection schema"] [fields="[{\"ID\":100,\"Name\":\"only_id\",\"PrimaryKey\":true,\"AutoID\":false,\"Description\":\"\",\"DataType\":21,\"TypeParams\":{\"max_length\":\"100\"},\"IndexParams\":{},\"IsDynamic\":false,\"IsPartitionKey\":false},{\"ID\":101,\"Name\":\"embedding\",\"PrimaryKey\":false,\"AutoID\":false,\"Description\":\"\",\"DataType\":101,\"TypeParams\":{\"dim\":\"1024\"},\"IndexParams\":{},\"IsDynamic\":false,\"IsPartitionKey\":false}]"] [2023/10/26 19:31:24.459 +08:00] [INFO] [core/backup_impl_restore_backup.go:418] ["create collection"] [database=default] [collectionName=chinese_embedding_flag_bak] [hasPartitionKey=false] [2023/10/26 19:31:24.462 +08:00] [INFO] [core/backup_impl_restore_backup.go:451] ["create partition"] [collectionName=chinese_embedding_flag_bak] [partitionName=_default] [2023/10/26 19:31:24.462 +08:00] [INFO] [core/backup_impl_restore_backup.go:625] [getBackupPartitionPaths] [bucketName=a-bucket] [backupPath=backup/chinese_embedding_flag] [partitionID=445157764551563152] [2023/10/26 19:31:24.483 +08:00] [INFO] [core/backup_impl_restore_backup.go:593] ["bulkinsert task state"] [id=445157764551763825] [state=2] [state="{\"ID\":445157764551763825,\"State\":2,\"RowCount\":0,\"IDList\":null,\"Infos\":{\"backup\":\"true\",\"collection\":\"chinese_embedding_flag_bak\",\"end_ts\":\"445204356136960\",\"failed_reason\":\"\",\"files\":\"backup/chinese_embedding_flag/binlogs/insert_log/445157764551563151/445157764551563152/,\",\"partition\":\"_default\"},\"CollectionID\":445157764551763821,\"SegmentIDs\":null,\"CreateTs\":1698319884}"] [progress=0] [currentTimestamp=1698319884] [lastUpdateTime=1698319884] [2023/10/26 19:31:29.490 +08:00] [INFO] [core/backup_impl_restore_backup.go:593] ["bulkinsert task state"] [id=445157764551763825] [state=6] [state="{\"ID\":445157764551763825,\"State\":6,\"RowCount\":0,\"IDList\":null,\"Infos\":{\"backup\":\"true\",\"collection\":\"chinese_embedding_flag_bak\",\"end_ts\":\"445204356136960\",\"failed_reason\":\"\",\"files\":\"backup/chinese_embedding_flag/binlogs/insert_log/445157764551563151/445157764551563152/,\",\"partition\":\"_default\",\"persist_cost\":\"0.02\",\"progress_percent\":\"100\"},\"CollectionID\":445157764551763821,\"SegmentIDs\":null,\"CreateTs\":1698319884}"] [progress=100] [currentTimestamp=1698319889] [lastUpdateTime=1698319884] [2023/10/26 19:31:29.490 +08:00] [INFO] [core/backup_impl_restore_backup.go:335] ["finish restore collection"] [db_name=default] [collection_name=chinese_embedding_flag_bak]
Expected Behavior
No response
Steps To Reproduce
No response
Environment
No response
Anything else?
No response