search

milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
30.87k stars 2.94k forks source link

[Enhancement]: Upgrade Pulsar to 3.x #30812

Open haorenfsa opened 9 months ago

haorenfsa commented 9 months ago

Is there an existing issue for this?

What would you like to be added?

Upgrade Pulsar to 3.x

Why is this needed?

Anything else?

ref:

dependency:

stale[bot] commented 7 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

rere950303 commented 7 months ago

@haorenfsa thanks for your works, Do you have any plans to increase the pulsar version to 3.0.1? I would like to change the pulsar version used in milvus 2.3.12 to 2.10.0 because of volume directive issues in dockerfile. I don't think there will be any big issues when referring to the minor version release note. Are there any expected issues? I would appreciate it if you could comment briefly.

xiaofan-luan commented 7 months ago

@haorenfsa thanks for your works, Do you have any plans to increase the pulsar version to 3.0.1? I would like to change the pulsar version used in milvus 2.3.12 to 2.10.0 because of volume directive issues in dockerfile. I don't think there will be any big issues when referring to the minor version release note. Are there any expected issues? I would appreciate it if you could comment briefly.

So which version you are targeting to use? 2.10 or 3.0.1? We would recommend to use 3.0.1 since we test it thoroughly

rere950303 commented 7 months ago

@xiaofan-luan thanks for answer, In milvus 2.3.12 version, I was originally going to use the pulsar 2.10.0 version. do you mean that there is no issue with using the pulsar 3.0.1 version???

stale[bot] commented 6 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

xiaofan-luan commented 6 months ago

keep this. @haorenfsa is there a deadline for this?

haorenfsa commented 6 months ago

@xiaofan-luan One must first upgrade pulsar to some other 2.x version before one can upgrade to 3.0.1. @LoveEachDay will write a doc about the upgrading route, before we change the default version to 3.0.1 in helm chart. /assign @LoveEachDay

stale[bot] commented 5 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

haorenfsa commented 4 months ago

/reopen

sre-ci-robot commented 4 months ago

@haorenfsa: Reopened this issue.

In response to [this](https://github.com/milvus-io/milvus/issues/30812#issuecomment-2198274809): >/reopen Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.
stale[bot] commented 3 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

haorenfsa commented 3 months ago

keep alive

stale[bot] commented 2 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

haorenfsa commented 2 months ago

milvus-operator now supports pulsar v3 https://github.com/zilliztech/milvus-operator/pull/182#event-14169040762 but only for new milvus instance. Manifest example is in https://github.com/zilliztech/milvus-operator/blob/main/config/samples/milvus_pulsar_v3.yaml.

The upgrade plan from v2 is still under design.

haorenfsa commented 1 month ago

/assign

haorenfsa commented 1 month ago

https://github.com/milvus-io/milvus/pull/36435

stale[bot] commented 1 week ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

haorenfsa commented 1 week ago

keep alive

xiaofan-luan commented 1 week ago

can we do it in Milvus 2.5?

haorenfsa commented 1 week ago

Yes