search

zilliztech / milvus-backup

Backup and restore tool for Milvus
Apache License 2.0
137 stars 50 forks source link

[Bug]: The backup tool on the main branch cannot work on the image of Milvus master #448

Closed zhuwenxing closed 2 weeks ago

zhuwenxing commented 4 weeks ago

Current Behavior

[2024/10/29 15:32:18.896 +08:00] [ERROR] [core/backup_impl_create_backup.go:215] ["fail in HasCollection"] [error="response status is nil"] [errorVerbose="response status is nil\n(1) attached stack trace\n  -- stack trace:\n  | github.com/milvus-io/milvus-sdk-go/v2/client.init\n  | \t/Users/zilliz/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.2-0.20241009111120-8008f14f2c16/client/errors.go:28\n  | runtime.doInit1\n  | \t/usr/local/Cellar/go/1.23.0/libexec/src/runtime/proc.go:7278\n  | runtime.doInit\n  | \t/usr/local/Cellar/go/1.23.0/libexec/src/runtime/proc.go:7245\n  | runtime.main\n  | \t/usr/local/Cellar/go/1.23.0/libexec/src/runtime/proc.go:254\n  | runtime.goexit\n  | \t/usr/local/Cellar/go/1.23.0/libexec/src/runtime/asm_amd64.s:1700\nWraps: (2) response status is nil\nError types: (1) *withstack.withStack (2) *errutil.leafError"] [stack="github.com/zilliztech/milvus-backup/core.(*BackupContext).parseBackupCollections\n\t/Users/zilliz/workspace/milvus-backup/core/backup_impl_create_backup.go:215\ngithub.com/zilliztech/milvus-backup/core.(*BackupContext).executeCreateBackup\n\t/Users/zilliz/workspace/milvus-backup/core/backup_impl_create_backup.go:685\ngithub.com/zilliztech/milvus-backup/core.(*BackupContext).CreateBackup\n\t/Users/zilliz/workspace/milvus-backup/core/backup_impl_create_backup.go:113\ngithub.com/zilliztech/milvus-backup/core.(*Handlers).handleCreateBackup\n\t/Users/zilliz/workspace/milvus-backup/core/backup_server.go:146\ngithub.com/zilliztech/milvus-backup/core.(*Handlers).RegisterRoutesTo.wrapHandler.func2\n\t/Users/zilliz/workspace/milvus-backup/core/backup_server.go:125\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/context.go:173\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/recovery.go:101\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/context.go:173\ngithub.com/gin-gonic/gin.LoggerWithConfig.func1\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/logger.go:240\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/context.go:173\ngithub.com/gin-gonic/gin.(*Engine).handleHTTPRequest\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/gin.go:616\ngithub.com/gin-gonic/gin.(*Engine).ServeHTTP\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/gin.go:572\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/Cellar/go/1.23.0/libexec/src/net/http/server.go:3210\nnet/http.(*conn).serve\n\t/usr/local/Cellar/go/1.23.0/libexec/src/net/http/server.go:2092"]
[2024/10/29 15:32:18.897 +08:00] [ERROR] [core/backup_impl_create_backup.go:687] ["parse backup collections from request failed"] [error="response status is nil"] [errorVerbose="response status is nil\n(1) attached stack trace\n  -- stack trace:\n  | github.com/milvus-io/milvus-sdk-go/v2/client.init\n  | \t/Users/zilliz/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.2-0.20241009111120-8008f14f2c16/client/errors.go:28\n  | runtime.doInit1\n  | \t/usr/local/Cellar/go/1.23.0/libexec/src/runtime/proc.go:7278\n  | runtime.doInit\n  | \t/usr/local/Cellar/go/1.23.0/libexec/src/runtime/proc.go:7245\n  | runtime.main\n  | \t/usr/local/Cellar/go/1.23.0/libexec/src/runtime/proc.go:254\n  | runtime.goexit\n  | \t/usr/local/Cellar/go/1.23.0/libexec/src/runtime/asm_amd64.s:1700\nWraps: (2) response status is nil\nError types: (1) *withstack.withStack (2) *errutil.leafError"] [stack="github.com/zilliztech/milvus-backup/core.(*BackupContext).executeCreateBackup\n\t/Users/zilliz/workspace/milvus-backup/core/backup_impl_create_backup.go:687\ngithub.com/zilliztech/milvus-backup/core.(*BackupContext).CreateBackup\n\t/Users/zilliz/workspace/milvus-backup/core/backup_impl_create_backup.go:113\ngithub.com/zilliztech/milvus-backup/core.(*Handlers).handleCreateBackup\n\t/Users/zilliz/workspace/milvus-backup/core/backup_server.go:146\ngithub.com/zilliztech/milvus-backup/core.(*Handlers).RegisterRoutesTo.wrapHandler.func2\n\t/Users/zilliz/workspace/milvus-backup/core/backup_server.go:125\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/context.go:173\ngithub.com/gin-gonic/gin.CustomRecoveryWithWriter.func1\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/recovery.go:101\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/context.go:173\ngithub.com/gin-gonic/gin.LoggerWithConfig.func1\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/logger.go:240\ngithub.com/gin-gonic/gin.(*Context).Next\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/context.go:173\ngithub.com/gin-gonic/gin.(*Engine).handleHTTPRequest\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/gin.go:616\ngithub.com/gin-gonic/gin.(*Engine).ServeHTTP\n\t/Users/zilliz/go/pkg/mod/github.com/gin-gonic/gin@v1.8.1/gin.go:572\nnet/http.serverHandler.ServeHTTP\n\t/usr/local/Cellar/go/1.23.0/libexec/src/net/http/server.go:3210\nnet/http.(*conn).serve\n\t/usr/local/Cellar/go/1.23.0/libexec/src/net/http/server.go:2092"]

Error: 0/29 07:40:26.216 +00:00] [ERROR] [core/backup_impl_create_backup.go:290] ["fail in DescribeIndex"] [error="response status is nil"] [errorVerbose="response status is nil\n(1) attached stack trace\n  -- stack trace:\n  | github.com/milvus-io/milvus-sdk-go/v2/client.init\n  | \t/home/runner/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.2-0.20241009111120-8008f14f2c16/client/errors.go:28\n  | runtime.doInit\n  | \t/opt/hostedtoolcache/go/1.18.0/x64/src/runtime/proc.go:6222\n  | runtime.doInit\n  | \t/opt/hostedtoolcache/go/1.18.0/x64/src/runtime/proc.go:6199\n  | runtime.doInit\n  | \t/opt/hostedtoolcache/go/1.18.0/x64/src/runtime/proc.go:6199\n  | runtime.doInit\n  | \t/opt/hostedtoolcache/go/1.18.0/x64/src/runtime/proc.go:6199\n  | runtime.main\n  | \t/opt/hostedtoolcache/go/1.18.0/x64/src/runtime/proc.go:233\n  | runtime.goexit\n  | \t/opt/hostedtoolcache/go/1.18.0/x64/src/runtime/asm_amd64.s:1571\nWraps: (2) response status is nil\nError types: (1) *withstack.withStack (2) *errutil.leafError"] [stack="github.com/zilliztech/milvus-backup/core.(*BackupContext).backupCollectionPrepare\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_create_backup.go:290\ngithub.com/zilliztech/milvus-backup/core.(*BackupContext).executeCreateBackup.func1.1\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_create_backup.go:703\ngithub.com/zilliztech/milvus-backup/core.(*BackupContext).executeCreateBackup.func1\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_create_backup.go:719\ngithub.com/zilliztech/milvus-backup/internal/common.(*WorkerPool).work.func1\n\t/home/runner/work/milvus-backup/milvus-backup/internal/common/workerpool.go:70\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\t/home/runner/go/pkg/mod/golang.org/x/sync@v0.8.0/errgroup/errgroup.go:78"]

Expected Behavior

No response

Steps To Reproduce

No response

Environment

No response

Anything else?

No response

zhuwenxing commented 4 weeks ago

/assign @wayblink

It seems that there's a compatibility issue between the Go SDK 2.4 and the master branch of Milvus?

wayblink commented 2 weeks ago

fixed