milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
31.1k stars 2.96k forks source link

[Feature]: Support Milvus on docker swarm #27466

Open xiaofan-luan opened 1 year ago

xiaofan-luan commented 1 year ago

Is there an existing issue for this?

Is your feature request related to a problem? Please describe.

Milvus is now supported to deployed with docker compose, helm charts and kubernetes operator.

Docker Swarm is a container orchestration platform that allows users to manage and scale their applications effortlessly. By adding support for Docker Swarm, Milvus will become more accessible and easier to manage in a distributed environment, enhancing its usability in real-world scenarios.

Describe the solution you'd like.

To finish this issue, we need:

  1. Code contribution on https://github.com/milvus-io/milvus/tree/master/deployments about how to deploy on dockerwarm
  2. A demo and a detail usage guide.

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

reetasingh commented 1 year ago

Hi @xiaofan-luan some clarifying questions

  1. I see that we already have docker-compose.yaml files under https://github.com/milvus-io/milvus/tree/master/deployments/docker Do we want to use existing docker-compose.yaml files? or write a new one? I found docker compose files related to dev and standalone but nothing related to cluster.
  2. Also, should we create a new folder under https://github.com/milvus-io/milvus/tree/master/deployments for docker swarm instructions or under https://github.com/milvus-io/milvus/tree/master/deployments/docker ?
xiaofan-luan commented 1 year ago

2. ould we create a new folder under https://github.com/milvus-io/milvus/tree/master/deployments

Hi @reetasingh,

  1. The dockercompose.yaml is maintained by maintainers and I believe it would be a good start to use existing docker-compose.yaml. But current docker compose is only for standalone cluster I guess. For distributed we only support helm and K8s Operator.

  2. I prefer to have a new depolyments. current docker deployment I believe only support standalone

devMls commented 7 months ago

i would like have a docker swarm cluster support

xiaofan-luan commented 7 months ago

From my previous knowledge, the key challenge of docker swarm is network.

/assign @devMls

xiaofan-luan commented 7 months ago

I'm not an expert in docker swarm but @zwd1208 might be able to help