search

zilliztech / milvus-migration

16 stars 3 forks source link

[Bug]: query expression is empty #96

Closed mmahao closed 3 weeks ago

mmahao commented 4 weeks ago

Current Behavior

soure milvus version：2.2.16 target milvus version：2.4.8

`dumper: worker: workMode: milvus2x # work mode：milvus2x->milvus2x reader: bufferSize: 500 # Read source data rows in each time read from Source Milvus.

meta: # meta part mode: config # 'config' mode means will get meta config from this config file itself. version: 2.2.16 # Source Milvus version collection: xz_poi_name_v1 # migrate data from this source collection

source: # source milvus connection info milvus2x: endpoint: xxxxxxxx username: password:

target: # target milvus collection info milvus2x: endpoint: xxxxxxxx username: xxxxxxxx password: xxxxxxxx`

./milvus-migration start --config=/Users/mahao/development/project/milvus/milvus-migration/config/migration.yaml

[ERROR] [migration/milvus2x_starter.go:53] ["DumpByIterator err"] [error="query expression is empty"] [errorVerbose="query expression is empty\n(1) attached stack trace\n -- stack trace:\n | github.com/milvus-io/milvus-sdk-go/v2/client.handleRespStatus\n | \t/Users/mahao/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.1/client/collection.go:39\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*GrpcClient).Query\n | \t/Users/mahao/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.1/client/data.go:368\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*QueryIterator).fetchNextBatch\n | \t/Users/mahao/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.1/client/iterator.go:144\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*QueryIterator).init\n | \t/Users/mahao/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.1/client/iterator.go:109\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*GrpcClient).QueryIterator\n | \t/Users/mahao/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.1/client/iterator.go:75\n | github.com/zilliztech/milvus-migration/storage/milvus2x.(*Milvus23VerClient).InitIterator\n | \t/Users/mahao/development/project/milvus/milvus-migration/storage/milvus2x/milvus2_3_ver.go:59\n | github.com/zilliztech/milvus-migration/core/reader/source.(*Milvus2xSource).ReadFirst\n | \t/Users/mahao/development/project/milvus/milvus-migration/core/reader/source/milvus2x_source.go:42\n | github.com/zilliztech/milvus-migration/core/dumper.(*Dumper).ReadData2Channel\n | \t/Users/mahao/development/project/milvus/milvus-migration/core/dumper/mode_starter_milvus2x.go:45\n | github.com/zilliztech/milvus-migration/core/dumper.(*Dumper).WorkInMilvus2x\n | \t/Users/mahao/development/project/milvus/milvus-migration/core/dumper/mode_starter_milvus2x.go:33\n | github.com/zilliztech/milvus-migration/starter/migration.(*Starter).dumpByIterator\n | \t/Users/mahao/development/project/milvus/milvus-migration/starter/migration/milvus2x_starter.go:66\n | github.com/zilliztech/milvus-migration/starter/migration.(*Starter).DumpLoadInMilvus2x.func2\n | \t/Users/mahao/development/project/milvus/milvus-migration/starter/migration/milvus2x_starter.go:50\n | golang.org/x/sync/errgroup.(*Group).Go.func1\n | \t/Users/mahao/go/pkg/mod/golang.org/x/sync@v0.5.0/errgroup/errgroup.go:75\n | runtime.goexit\n | \t/usr/local/go/src/runtime/asm_arm64.s:1222\nWraps: (2) query expression is empty\nError types: (1) *withstack.withStack (2) *errutil.leafError"] [stack="github.com/zilliztech/milvus-migration/starter/migration.(*Starter).DumpLoadInMilvus2x.func2\n\t/Users/mahao/development/project/milvus/milvus-migration/starter/migration/milvus2x_starter.go:53\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\t/Users/mahao/go/pkg/mod/golang.org/x/sync@v0.5.0/errgroup/errgroup.go:75"] [2024/08/19 15:37:05.957 +08:00] [ERROR] [cmd/start.go:34] ["[start migration error]"] [error="query expression is empty"] [errorVerbose="query expression is empty\n(1) attached stack trace\n -- stack trace:\n | github.com/milvus-io/milvus-sdk-go/v2/client.handleRespStatus\n | \t/Users/mahao/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.1/client/collection.go:39\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*GrpcClient).Query\n | \t/Users/mahao/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.1/client/data.go:368\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*QueryIterator).fetchNextBatch\n | \t/Users/mahao/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.1/client/iterator.go:144\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*QueryIterator).init\n | \t/Users/mahao/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.1/client/iterator.go:109\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*GrpcClient).QueryIterator\n | \t/Users/mahao/go/pkg/mod/github.com/milvus-io/milvus-sdk-go/v2@v2.4.1/client/iterator.go:75\n | github.com/zilliztech/milvus-migration/storage/milvus2x.(*Milvus23VerClient).InitIterator\n | \t/Users/mahao/development/project/milvus/milvus-migration/storage/milvus2x/milvus2_3_ver.go:59\n | github.com/zilliztech/milvus-migration/core/reader/source.(*Milvus2xSource).ReadFirst\n | \t/Users/mahao/development/project/milvus/milvus-migration/core/reader/source/milvus2x_source.go:42\n | github.com/zilliztech/milvus-migration/core/dumper.(*Dumper).ReadData2Channel\n | \t/Users/mahao/development/project/milvus/milvus-migration/core/dumper/mode_starter_milvus2x.go:45\n | github.com/zilliztech/milvus-migration/core/dumper.(*Dumper).WorkInMilvus2x\n | \t/Users/mahao/development/project/milvus/milvus-migration/core/dumper/mode_starter_milvus2x.go:33\n | github.com/zilliztech/milvus-migration/starter/migration.(*Starter).dumpByIterator\n | \t/Users/mahao/development/project/milvus/milvus-migration/starter/migration/milvus2x_starter.go:66\n | github.com/zilliztech/milvus-migration/starter/migration.(*Starter).DumpLoadInMilvus2x.func2\n | \t/Users/mahao/development/project/milvus/milvus-migration/starter/migration/milvus2x_starter.go:50\n | golang.org/x/sync/errgroup.(*Group).Go.func1\n | \t/Users/mahao/go/pkg/mod/golang.org/x/sync@v0.5.0/errgroup/errgroup.go:75\n | runtime.goexit\n | \t/usr/local/go/src/runtime/asm_arm64.s:1222\nWraps: (2) query expression is empty\nError types: (1) *withstack.withStack (2) *errutil.leafError"] [stack="github.com/zilliztech/milvus-migration/cmd.init.func6\n\t/Users/mahao/development/project/milvus/milvus-migration/cmd/start.go:34\ngithub.com/spf13/cobra.(*Command).execute\n\t/Users/mahao/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:987\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\t/Users/mahao/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:1115\ngithub.com/spf13/cobra.(*Command).Execute\n\t/Users/mahao/go/pkg/mod/github.com/spf13/cobra@v1.8.0/command.go:1039\ngithub.com/zilliztech/milvus-migration/cmd.Execute\n\t/Users/mahao/development/project/milvus/milvus-migration/cmd/root.go:26\nmain.main\n\t/Users/mahao/development/project/milvus/milvus-migration/main.go:16\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:271"]

Expected Behavior

No response

Steps To Reproduce

No response

Environment

No response

Anything else?

image Just one line of code change fixed it.

wenhuiZilliz commented 4 weeks ago

@mmahao Now support source Milvus version is: 2.3.0+, your source milvus version：2.2.16, so unexpected issues may arise