search

opensearch-project / neural-search

Plugin that adds dense neural retrieval into the OpenSearch ecosytem
Apache License 2.0
57 stars 58 forks source link

[BUG] Ingestion bug on multi-node cluster #714

Closed yuye-aws closed 2 months ago

yuye-aws commented 2 months ago

What is the bug?

For multi node cluster, the text chunking processor would produce "no such index" error if the configured shard number is less than the number of nodes.

How can one reproduce the bug?

Run integration test cases with a multi-node cluster

What is the expected behavior?

All integration test cases get passed with a three node cluster.

What is your host/environment?

Linux and Mac OS

Do you have any screenshots?

If applicable, add screenshots to help explain your problem.

Do you have any additional context?

Add any other context about the problem.

yuye-aws commented 2 months ago

Raised a PR to fix this issue: https://github.com/opensearch-project/neural-search/pull/713

yuye-aws commented 2 months ago

Current observation: https://github.com/opensearch-project/neural-search/pull/713 fixes BWC tests on BWC version 2.14, but BWC tests get failed at version 2.13

yuye-aws commented 2 months ago

Closing this issue because the PR has been merged. The BWC test issue will be tracked in another issue.