Question: deploy model out of cluster machines

ray-project / mlflow-ray-serve

MLFlow Deployment Plugin for Ray Serve

Apache License 2.0

42 stars 8 forks source link

Question: deploy model out of cluster machines #5

Open frascuchon opened 3 years ago

frascuchon commented 3 years ago

Hello,

I have a question regarding automatic ci/cd model builds. Do I need deploy from a ray cluster node or could I run from a remote bastion node ?

The ray cluster documentation points to cluster node solution, but I'm not really sure.

Thanks in advance!

frascuchon commented 3 years ago

I've seen the answer in this thread. So, for now, the mlflow deployment plugin doesn't support deploy mlflow models outside of ray cluster. I mean, you must run a mlflow deployment inside a cluster node, isn't it?