search

zilliztech / milvus-backup

Backup and restore tool for Milvus
Apache License 2.0
111 stars 38 forks source link

[Bug]: If there is an upsert operation before the backup, after the backup is restored, the data from the upsert will be considered as deleted #260

Closed zhuwenxing closed 6 months ago

zhuwenxing commented 6 months ago

Current Behavior

[2023-12-12 15:55:00 - INFO - ci_test]: [test][2023-12-12T07:54:59Z] [0.22774878s] restore_backup_CgQItHX8 insert -> (insert count: 3000, delete count: 0, upsert count: 0, timestamp: 446265478376062979, success count: 3000, err count: 0) (wrapper.py:30)
[2023-12-12 15:55:00 - INFO - ci_test]: [test][2023-12-12T07:55:00Z] [0.01402100s] restore_backup_CgQItHX8 upsert -> (insert count: 100, delete count: 100, upsert count: 100, timestamp: 446265478389170179, success count: 100, err count: 0) (wrapper.py:30)
[2023-12-12 15:55:03 - INFO - ci_test]: create_backup {'requestId': 'c01a5150-98c3-11ee-90db-acde48001122', 'msg': 'success', 'data': {'id': 'c01a5150-98c3-11ee-90db-acde48001122', 'state_code': 2, 'start_time': 1702367700410, 'end_time': 1702367703571, 'name': 'backup_NOkQdGdG', 'backup_timestamp': 1702367700410, 'collection_backups': [{'collection_id': 446263913484294202, 'db_name': 'default', 'collection_name': 'restore_backup_CgQItHX8', 'schema': {'name': 'restore_backup_CgQItHX8', 'fields': [{'fieldID': 100, 'name': 'int64', 'is_primary_key': True, 'data_type': 5}, {'fieldID': 101, 'name': 'key', 'data_type': 5}, {'fieldID': 102, 'name': 'json', 'data_type': 23}, {'fieldID': 103, 'name': 'var_array', 'data_type': 22, 'type_params': [{'key': 'max_length', 'value': '1500'}, {'key': 'max_capacity', 'value': '2000'}], 'element_type': 21}, {'fieldID': 104, 'name': 'int_array', 'data_type': 22, 'type_params': [{'key': 'max_length', 'value': '1500'}, {'key': 'max_capacity', 'value': '2000'}], 'element_type': 5}, {'fieldID': 105, 'name': 'float_vector', 'data_type': 101, 'type_params': [{'key': 'dim', 'value': '128'}]}]}, 'backup_timestamp': 446265478348800, 'size': 49781, 'has_index': False, 'load_state': 'NotLoad', 'backup_physical_timestamp': 1702367700}], 'size': 49781, 'milvus_version': 'd2207cac'}} (test_restore_backup.py:484)
[2023-12-12 15:55:03 - INFO - ci_test]: list_backup {'requestId': 'c20adf3e-98c3-11ee-90db-acde48001122', 'msg': 'success', 'data': [{'id': 'bd01f676-98be-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_2ZKDdClh', 'backup_timestamp': 1702365547735, 'size': 0}, {'id': '47a7a8a0-98bc-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_AJmTYPcz', 'backup_timestamp': 1702364491855, 'size': 0}, {'id': '114051c6-98bd-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_CDxCzznE', 'backup_timestamp': 1702364830077, 'size': 0}, {'id': 'b44d93ca-98c1-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_GttgYiZS', 'backup_timestamp': 1702366821620, 'size': 0}, {'id': '3d436fb4-98c3-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_GzoZDMXf', 'backup_timestamp': 1702367480898, 'size': 0}, {'id': '4810b5d0-98bb-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_N8GkQ37o', 'backup_timestamp': 1702364063054, 'size': 0}, {'id': 'c01a5150-98c3-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_NOkQdGdG', 'backup_timestamp': 1702367700410, 'size': 0}, {'id': 'b37277a8-98c2-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_TvuMW6JJ', 'backup_timestamp': 1702367249680, 'size': 0}, {'id': '0434b02a-98c3-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_akHlb2io', 'backup_timestamp': 1702367385172, 'size': 0}, {'id': '2d5803f2-98bf-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_qZOaQykw', 'backup_timestamp': 1702365736202, 'size': 0}, {'id': 'd956f940-98bc-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_tMywlpn4', 'backup_timestamp': 1702364736273, 'size': 0}, {'id': 'ceba043e-98ba-11ee-b4f1-acde48001122', 'state_code': 2, 'name': 'backup_v7qZekJv', 'backup_timestamp': 1702363859475, 'size': 0}]} (test_restore_backup.py:486)
[2023-12-12 15:55:14 - INFO - ci_test]: restore_backup: {'requestId': 'c2150c84-98c3-11ee-90db-acde48001122', 'msg': 'success', 'data': {'id': 'c21520de-98c3-11ee-90db-acde48001122', 'state_code': 2, 'start_time': 1702367703, 'end_time': 1702367714, 'collection_restore_tasks': [{'id': 'c2268bc6-98c3-11ee-90db-acde48001122', 'state_code': 2, 'start_time': 1702367703, 'target_collection_name': 'restore_backup_CgQItHX8_bak', 'restored_size': 49781, 'to_restore_size': 49781, 'progress': 100, 'target_db_name': 'default'}], 'restored_size': 0, 'to_restore_size': 0, 'progress': 100}} (test_restore_backup.py:498)
[2023-12-12 15:55:14 - INFO - ci_test]: collection_src schema: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'json', 'description': '', 'type': <DataType.JSON: 23>}, {'name': 'var_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': '1500', 'max_capacity': '2000'}, 'element_type': 21}, {'name': 'int_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': '1500', 'max_capacity': '2000'}, 'element_type': 5}, {'name': 'float_vector', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}]} (client_base.py:348)
[2023-12-12 15:55:14 - INFO - ci_test]: collection_dist schema: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'json', 'description': '', 'type': <DataType.JSON: 23>}, {'name': 'var_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': '1500', 'max_capacity': '2000'}, 'element_type': 21}, {'name': 'int_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': '1500', 'max_capacity': '2000'}, 'element_type': 5}, {'name': 'float_vector', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}]} (client_base.py:349)
[2023-12-12 15:55:14 - INFO - ci_test]: partitions_src: [{"name":"_default","collection_name":"restore_backup_CgQItHX8","description":""}], partitions_dist: [{"name":"_default","collection_name":"restore_backup_CgQItHX8_bak","description":""}] (client_base.py:354)
[2023-12-12 15:55:14 - INFO - ci_test]: src_num: 3100, dist_num: 2900 (client_base.py:359)
[2023-12-12 15:55:35 - INFO - ci_test]: src count: [{'count(*)': 3000}], dist count: [{'count(*)': 2900}] (client_base.py:381)
[2023-12-12 15:55:37 - INFO - ci_test]: diff: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99] (client_base.py:398)

Expected Behavior

bak collection count is the same as the origin collection

Steps To Reproduce

create collection
insert 3000 data
upsert first 100 rows
create backup
restore 
compare two collections

Environment

No response

Anything else?

client log

[2023-12-12 15:55:00 - INFO - ci_test]: [test][2023-12-12T07:54:59Z] [0.22774878s] restore_backup_CgQItHX8 insert -> (insert count: 3000, delete count: 0, upsert count: 0, timestamp: 446265478376062979, success count: 3000, err count: 0) (wrapper.py:30)
[2023-12-12 15:55:00 - INFO - ci_test]: [test][2023-12-12T07:55:00Z] [0.01402100s] restore_backup_CgQItHX8 upsert -> (insert count: 100, delete count: 100, upsert count: 100, timestamp: 446265478389170179, success count: 100, err count: 0) (wrapper.py:30)
[2023-12-12 15:55:03 - INFO - ci_test]: create_backup {'requestId': 'c01a5150-98c3-11ee-90db-acde48001122', 'msg': 'success', 'data': {'id': 'c01a5150-98c3-11ee-90db-acde48001122', 'state_code': 2, 'start_time': 1702367700410, 'end_time': 1702367703571, 'name': 'backup_NOkQdGdG', 'backup_timestamp': 1702367700410, 'collection_backups': [{'collection_id': 446263913484294202, 'db_name': 'default', 'collection_name': 'restore_backup_CgQItHX8', 'schema': {'name': 'restore_backup_CgQItHX8', 'fields': [{'fieldID': 100, 'name': 'int64', 'is_primary_key': True, 'data_type': 5}, {'fieldID': 101, 'name': 'key', 'data_type': 5}, {'fieldID': 102, 'name': 'json', 'data_type': 23}, {'fieldID': 103, 'name': 'var_array', 'data_type': 22, 'type_params': [{'key': 'max_length', 'value': '1500'}, {'key': 'max_capacity', 'value': '2000'}], 'element_type': 21}, {'fieldID': 104, 'name': 'int_array', 'data_type': 22, 'type_params': [{'key': 'max_length', 'value': '1500'}, {'key': 'max_capacity', 'value': '2000'}], 'element_type': 5}, {'fieldID': 105, 'name': 'float_vector', 'data_type': 101, 'type_params': [{'key': 'dim', 'value': '128'}]}]}, 'backup_timestamp': 446265478348800, 'size': 49781, 'has_index': False, 'load_state': 'NotLoad', 'backup_physical_timestamp': 1702367700}], 'size': 49781, 'milvus_version': 'd2207cac'}} (test_restore_backup.py:484)
[2023-12-12 15:55:03 - INFO - ci_test]: list_backup {'requestId': 'c20adf3e-98c3-11ee-90db-acde48001122', 'msg': 'success', 'data': [{'id': 'bd01f676-98be-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_2ZKDdClh', 'backup_timestamp': 1702365547735, 'size': 0}, {'id': '47a7a8a0-98bc-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_AJmTYPcz', 'backup_timestamp': 1702364491855, 'size': 0}, {'id': '114051c6-98bd-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_CDxCzznE', 'backup_timestamp': 1702364830077, 'size': 0}, {'id': 'b44d93ca-98c1-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_GttgYiZS', 'backup_timestamp': 1702366821620, 'size': 0}, {'id': '3d436fb4-98c3-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_GzoZDMXf', 'backup_timestamp': 1702367480898, 'size': 0}, {'id': '4810b5d0-98bb-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_N8GkQ37o', 'backup_timestamp': 1702364063054, 'size': 0}, {'id': 'c01a5150-98c3-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_NOkQdGdG', 'backup_timestamp': 1702367700410, 'size': 0}, {'id': 'b37277a8-98c2-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_TvuMW6JJ', 'backup_timestamp': 1702367249680, 'size': 0}, {'id': '0434b02a-98c3-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_akHlb2io', 'backup_timestamp': 1702367385172, 'size': 0}, {'id': '2d5803f2-98bf-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_qZOaQykw', 'backup_timestamp': 1702365736202, 'size': 0}, {'id': 'd956f940-98bc-11ee-90db-acde48001122', 'state_code': 2, 'name': 'backup_tMywlpn4', 'backup_timestamp': 1702364736273, 'size': 0}, {'id': 'ceba043e-98ba-11ee-b4f1-acde48001122', 'state_code': 2, 'name': 'backup_v7qZekJv', 'backup_timestamp': 1702363859475, 'size': 0}]} (test_restore_backup.py:486)
[2023-12-12 15:55:14 - INFO - ci_test]: restore_backup: {'requestId': 'c2150c84-98c3-11ee-90db-acde48001122', 'msg': 'success', 'data': {'id': 'c21520de-98c3-11ee-90db-acde48001122', 'state_code': 2, 'start_time': 1702367703, 'end_time': 1702367714, 'collection_restore_tasks': [{'id': 'c2268bc6-98c3-11ee-90db-acde48001122', 'state_code': 2, 'start_time': 1702367703, 'target_collection_name': 'restore_backup_CgQItHX8_bak', 'restored_size': 49781, 'to_restore_size': 49781, 'progress': 100, 'target_db_name': 'default'}], 'restored_size': 0, 'to_restore_size': 0, 'progress': 100}} (test_restore_backup.py:498)
[2023-12-12 15:55:14 - INFO - ci_test]: collection_src schema: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'json', 'description': '', 'type': <DataType.JSON: 23>}, {'name': 'var_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': '1500', 'max_capacity': '2000'}, 'element_type': 21}, {'name': 'int_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': '1500', 'max_capacity': '2000'}, 'element_type': 5}, {'name': 'float_vector', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}]} (client_base.py:348)
[2023-12-12 15:55:14 - INFO - ci_test]: collection_dist schema: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'json', 'description': '', 'type': <DataType.JSON: 23>}, {'name': 'var_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': '1500', 'max_capacity': '2000'}, 'element_type': 21}, {'name': 'int_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': '1500', 'max_capacity': '2000'}, 'element_type': 5}, {'name': 'float_vector', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}]} (client_base.py:349)
[2023-12-12 15:55:14 - INFO - ci_test]: partitions_src: [{"name":"_default","collection_name":"restore_backup_CgQItHX8","description":""}], partitions_dist: [{"name":"_default","collection_name":"restore_backup_CgQItHX8_bak","description":""}] (client_base.py:354)
[2023-12-12 15:55:14 - INFO - ci_test]: src_num: 3100, dist_num: 2900 (client_base.py:359)
[2023-12-12 15:55:35 - INFO - ci_test]: src count: [{'count(*)': 3000}], dist count: [{'count(*)': 2900}] (client_base.py:381)
[2023-12-12 15:55:37 - INFO - ci_test]: diff: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99] (client_base.py:398)

backup log

[GIN] 2023/12/12 - 15:55:03 | 200 |  3.247660822s |             ::1 | POST     "/api/v1/create"
[2023/12/12 15:55:03.660 +08:00] [INFO] [core/backup_context.go:289] ["receive ListBackupsRequest"] [requestId=c20adf3e-98c3-11ee-90db-acde48001122] [collectionName=]
[2023/12/12 15:55:03.671 +08:00] [INFO] [core/backup_context.go:315] ["List Backups' path"] [backup_paths="[backup/backup_2ZKDdClh/,backup/backup_AJmTYPcz/,backup/backup_CDxCzznE/,backup/backup_GttgYiZS/,backup/backup_GzoZDMXf/,backup/backup_N8GkQ37o/,backup/backup_NOkQdGdG/,backup/backup_TvuMW6JJ/,backup/backup_akHlb2io/,backup/backup_qZOaQykw/,backup/backup_tMywlpn4/,backup/backup_v7qZekJv/]"]
[2023/12/12 15:55:03.671 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20ca756-98c3-11ee-90db-acde48001122] [backupName=backup_2ZKDdClh] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.671 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20ca756-98c3-11ee-90db-acde48001122] [backupName=backup_2ZKDdClh] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.671 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20cae36-98c3-11ee-90db-acde48001122] [backupName=backup_AJmTYPcz] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20cae36-98c3-11ee-90db-acde48001122] [backupName=backup_AJmTYPcz] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20cb0b6-98c3-11ee-90db-acde48001122] [backupName=backup_CDxCzznE] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20cb0b6-98c3-11ee-90db-acde48001122] [backupName=backup_CDxCzznE] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20cb6f6-98c3-11ee-90db-acde48001122] [backupName=backup_GttgYiZS] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20cb6f6-98c3-11ee-90db-acde48001122] [backupName=backup_GttgYiZS] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20cb98a-98c3-11ee-90db-acde48001122] [backupName=backup_GzoZDMXf] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20cb98a-98c3-11ee-90db-acde48001122] [backupName=backup_GzoZDMXf] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20cc47a-98c3-11ee-90db-acde48001122] [backupName=backup_N8GkQ37o] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20cc47a-98c3-11ee-90db-acde48001122] [backupName=backup_N8GkQ37o] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20cc826-98c3-11ee-90db-acde48001122] [backupName=backup_NOkQdGdG] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20cc826-98c3-11ee-90db-acde48001122] [backupName=backup_NOkQdGdG] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20cc9fc-98c3-11ee-90db-acde48001122] [backupName=backup_TvuMW6JJ] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20cc9fc-98c3-11ee-90db-acde48001122] [backupName=backup_TvuMW6JJ] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20ccc7c-98c3-11ee-90db-acde48001122] [backupName=backup_akHlb2io] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20ccc7c-98c3-11ee-90db-acde48001122] [backupName=backup_akHlb2io] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20cd32a-98c3-11ee-90db-acde48001122] [backupName=backup_qZOaQykw] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.672 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20cd32a-98c3-11ee-90db-acde48001122] [backupName=backup_qZOaQykw] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.673 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20cd726-98c3-11ee-90db-acde48001122] [backupName=backup_tMywlpn4] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.673 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20cd726-98c3-11ee-90db-acde48001122] [backupName=backup_tMywlpn4] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.673 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c20cd8ca-98c3-11ee-90db-acde48001122] [backupName=backup_v7qZekJv] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.712 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c20cd8ca-98c3-11ee-90db-acde48001122] [backupName=backup_v7qZekJv] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.712 +08:00] [INFO] [core/backup_context.go:354] ["return ListBackupsResponse"] [requestId=c20adf3e-98c3-11ee-90db-acde48001122] [code=0] [msg=success] ["data: list_backup_names"="[backup_2ZKDdClh,backup_AJmTYPcz,backup_CDxCzznE,backup_GttgYiZS,backup_GzoZDMXf,backup_N8GkQ37o,backup_NOkQdGdG,backup_TvuMW6JJ,backup_akHlb2io,backup_qZOaQykw,backup_tMywlpn4,backup_v7qZekJv]"]
[GIN] 2023/12/12 - 15:55:03 | 200 |   52.899185ms |             ::1 | GET      "/api/v1/list"
[2023/12/12 15:55:03.719 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c213f128-98c3-11ee-90db-acde48001122] [backupName=backup_NOkQdGdG] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.719 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c213f128-98c3-11ee-90db-acde48001122] [backupName=backup_NOkQdGdG] [backupId=] [bucketName=] [path=]
[GIN] 2023/12/12 - 15:55:03 | 200 |     241.752µs |             ::1 | GET      "/api/v1/get_backup?backup_name=backup_NOkQdGdG"
[2023/12/12 15:55:03.726 +08:00] [INFO] [core/backup_impl_restore_backup.go:26] ["receive RestoreBackupRequest"] [requestId=c2150c84-98c3-11ee-90db-acde48001122] [backupName=backup_NOkQdGdG] [onlyMeta=false] [restoreIndex=false] [collections="[restore_backup_CgQItHX8]"] [CollectionSuffix=_bak] [CollectionRenames=null] [async=false] [bucketName=] [path=] [databaseCollections=]
[2023/12/12 15:55:03.727 +08:00] [INFO] [core/backup_context.go:194] ["receive GetBackupRequest"] [requestId=c2151a76-98c3-11ee-90db-acde48001122] [backupName=backup_NOkQdGdG] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.727 +08:00] [INFO] [core/backup_context.go:274] ["finish GetBackupRequest"] [requestId=c2151a76-98c3-11ee-90db-acde48001122] [backupName=backup_NOkQdGdG] [backupId=] [bucketName=] [path=]
[2023/12/12 15:55:03.727 +08:00] [INFO] [core/backup_impl_restore_backup.go:171] ["Collections to restore"] [collection_num=1]
[2023/12/12 15:55:03.841 +08:00] [INFO] [core/backup_impl_restore_backup.go:316] ["Start collection level restore pool"] [parallelism=2]
[2023/12/12 15:55:03.841 +08:00] [INFO] [core/backup_impl_restore_backup.go:322] ["executeRestoreBackupTask start"] [backup_name=backup_NOkQdGdG] [backupBucketName=a-bucket] [backupPath=backup/backup_NOkQdGdG]
[2023/12/12 15:55:03.841 +08:00] [INFO] [core/backup_impl_restore_backup.go:374] ["start restore"] [db_name=default] [collection_name=restore_backup_CgQItHX8_bak] [backupBucketName=a-bucket] [backupPath=backup/backup_NOkQdGdG]
[2023/12/12 15:55:03.841 +08:00] [INFO] [core/backup_impl_restore_backup.go:401] ["collection schema"] [fields="[{\"ID\":100,\"Name\":\"int64\",\"PrimaryKey\":true,\"AutoID\":false,\"Description\":\"\",\"DataType\":5,\"TypeParams\":{},\"IndexParams\":{},\"IsDynamic\":false,\"IsPartitionKey\":false,\"ElementType\":0},{\"ID\":101,\"Name\":\"key\",\"PrimaryKey\":false,\"AutoID\":false,\"Description\":\"\",\"DataType\":5,\"TypeParams\":{},\"IndexParams\":{},\"IsDynamic\":false,\"IsPartitionKey\":false,\"ElementType\":0},{\"ID\":102,\"Name\":\"json\",\"PrimaryKey\":false,\"AutoID\":false,\"Description\":\"\",\"DataType\":23,\"TypeParams\":{},\"IndexParams\":{},\"IsDynamic\":false,\"IsPartitionKey\":false,\"ElementType\":0},{\"ID\":103,\"Name\":\"var_array\",\"PrimaryKey\":false,\"AutoID\":false,\"Description\":\"\",\"DataType\":22,\"TypeParams\":{\"max_capacity\":\"2000\",\"max_length\":\"1500\"},\"IndexParams\":{},\"IsDynamic\":false,\"IsPartitionKey\":false,\"ElementType\":21},{\"ID\":104,\"Name\":\"int_array\",\"PrimaryKey\":false,\"AutoID\":false,\"Description\":\"\",\"DataType\":22,\"TypeParams\":{\"max_capacity\":\"2000\",\"max_length\":\"1500\"},\"IndexParams\":{},\"IsDynamic\":false,\"IsPartitionKey\":false,\"ElementType\":5},{\"ID\":105,\"Name\":\"float_vector\",\"PrimaryKey\":false,\"AutoID\":false,\"Description\":\"\",\"DataType\":101,\"TypeParams\":{\"dim\":\"128\"},\"IndexParams\":{},\"IsDynamic\":false,\"IsPartitionKey\":false,\"ElementType\":0}]"]
[2023/12/12 15:55:03.901 +08:00] [INFO] [core/backup_impl_restore_backup.go:436] ["create collection"] [database=default] [collectionName=restore_backup_CgQItHX8_bak] [hasPartitionKey=false]
[2023/12/12 15:55:03.901 +08:00] [INFO] [core/backup_impl_restore_backup.go:470] ["start restore partition"] [backupCollectionName=restore_backup_CgQItHX8] [targetDBName=default] [targetCollectionName=restore_backup_CgQItHX8_bak] [partition=_default]
[2023/12/12 15:55:03.939 +08:00] [INFO] [core/backup_impl_restore_backup.go:516] ["create partition"] [collectionName=restore_backup_CgQItHX8_bak] [partitionName=_default]
[2023/12/12 15:55:03.939 +08:00] [INFO] [core/backup_impl_restore_backup.go:726] [getBackupPartitionPaths] [bucketName=a-bucket] [backupPath=backup/backup_NOkQdGdG] [partitionID=446263913484294203] [groupId=446263913484294212]
[2023/12/12 15:55:03.961 +08:00] [INFO] [core/backup_impl_restore_backup.go:627] ["execute bulk insert"] [db=default] [collection=restore_backup_CgQItHX8_bak] [partition=_default] [files="[backup/backup_NOkQdGdG/binlogs/insert_log/446263913484294202/446263913484294203/446263913484294212/,backup/backup_NOkQdGdG/binlogs/delta_log/446263913484294202/446263913484294203/446263913484294212/]"] [endTime=446265478348800]
[2023/12/12 15:55:03.985 +08:00] [INFO] [core/backup_impl_restore_backup.go:670] ["bulkinsert task state"] [id=446263913484294280] [state=2] [state="{\"ID\":446263913484294280,\"State\":2,\"RowCount\":0,\"IDList\":null,\"Infos\":{\"backup\":\"true\",\"collection\":\"restore_backup_CgQItHX8_bak\",\"end_ts\":\"446265478348800\",\"failed_reason\":\"\",\"files\":\"backup/backup_NOkQdGdG/binlogs/insert_log/446263913484294202/446263913484294203/446263913484294212/,backup/backup_NOkQdGdG/binlogs/delta_log/446263913484294202/446263913484294203/446263913484294212/\",\"partition\":\"_default\"},\"CollectionID\":446263913484294273,\"SegmentIDs\":null,\"CreateTs\":1702367703}"] [progress=0] [currentTimestamp=1702367703] [lastUpdateTime=1702367703]
[2023/12/12 15:55:08.988 +08:00] [INFO] [core/backup_impl_restore_backup.go:670] ["bulkinsert task state"] [id=446263913484294280] [state=6] [state="{\"ID\":446263913484294280,\"State\":6,\"RowCount\":1460,\"IDList\":null,\"Infos\":{\"backup\":\"true\",\"collection\":\"restore_backup_CgQItHX8_bak\",\"end_ts\":\"446265478348800\",\"failed_reason\":\"\",\"files\":\"backup/backup_NOkQdGdG/binlogs/insert_log/446263913484294202/446263913484294203/446263913484294212/,backup/backup_NOkQdGdG/binlogs/delta_log/446263913484294202/446263913484294203/446263913484294212/\",\"partition\":\"_default\",\"persist_cost\":\"0.57\",\"progress_percent\":\"100\"},\"CollectionID\":446263913484294273,\"SegmentIDs\":[446263913484294285],\"CreateTs\":1702367703}"] [progress=100] [currentTimestamp=1702367708] [lastUpdateTime=1702367703]
[2023/12/12 15:55:08.988 +08:00] [INFO] [core/backup_impl_restore_backup.go:726] [getBackupPartitionPaths] [bucketName=a-bucket] [backupPath=backup/backup_NOkQdGdG] [partitionID=446263913484294203] [groupId=446263913484294213]
[2023/12/12 15:55:08.991 +08:00] [INFO] [core/backup_impl_restore_backup.go:627] ["execute bulk insert"] [db=default] [collection=restore_backup_CgQItHX8_bak] [partition=_default] [files="[backup/backup_NOkQdGdG/binlogs/insert_log/446263913484294202/446263913484294203/446263913484294213/,backup/backup_NOkQdGdG/binlogs/delta_log/446263913484294202/446263913484294203/446263913484294213/]"] [endTime=446265478348800]
[2023/12/12 15:55:09.001 +08:00] [INFO] [core/backup_impl_restore_backup.go:670] ["bulkinsert task state"] [id=446263913484294312] [state=2] [state="{\"ID\":446263913484294312,\"State\":2,\"RowCount\":0,\"IDList\":null,\"Infos\":{\"backup\":\"true\",\"collection\":\"restore_backup_CgQItHX8_bak\",\"end_ts\":\"446265478348800\",\"failed_reason\":\"\",\"files\":\"backup/backup_NOkQdGdG/binlogs/insert_log/446263913484294202/446263913484294203/446263913484294213/,backup/backup_NOkQdGdG/binlogs/delta_log/446263913484294202/446263913484294203/446263913484294213/\",\"partition\":\"_default\"},\"CollectionID\":446263913484294273,\"SegmentIDs\":null,\"CreateTs\":1702367708}"] [progress=0] [currentTimestamp=1702367709] [lastUpdateTime=1702367708]
[2023/12/12 15:55:14.007 +08:00] [INFO] [core/backup_impl_restore_backup.go:670] ["bulkinsert task state"] [id=446263913484294312] [state=6] [state="{\"ID\":446263913484294312,\"State\":6,\"RowCount\":1440,\"IDList\":null,\"Infos\":{\"backup\":\"true\",\"collection\":\"restore_backup_CgQItHX8_bak\",\"end_ts\":\"446265478348800\",\"failed_reason\":\"\",\"files\":\"backup/backup_NOkQdGdG/binlogs/insert_log/446263913484294202/446263913484294203/446263913484294213/,backup/backup_NOkQdGdG/binlogs/delta_log/446263913484294202/446263913484294203/446263913484294213/\",\"partition\":\"_default\",\"persist_cost\":\"0.19\",\"progress_percent\":\"100\"},\"CollectionID\":446263913484294273,\"SegmentIDs\":[446263913484294314],\"CreateTs\":1702367708}"] [progress=100] [currentTimestamp=1702367714] [lastUpdateTime=1702367708]
[2023/12/12 15:55:14.007 +08:00] [INFO] [core/backup_impl_restore_backup.go:485] ["finish restore partition"] [backupCollectionName=restore_backup_CgQItHX8] [targetDBName=default] [targetCollectionName=restore_backup_CgQItHX8_bak] [partition=_default]
[2023/12/12 15:55:14.007 +08:00] [INFO] [core/backup_impl_restore_backup.go:345] ["finish restore collection"] [db_name=default] [collection_name=restore_backup_CgQItHX8_bak]
[GIN] 2023/12/12 - 15:55:14 | 200 | 10.281200763s |             ::1 | POST     "/api/v1/restore"
zhuwenxing commented 6 months ago

/assign @wayblink

wayblink commented 6 months ago

@zhuwenxing fix in the latest master, please verify this case

zhuwenxing commented 6 months ago

verified see https://github.com/zilliztech/milvus-backup/actions/runs/7220661327/job/19674060752