FlowiseAI / Flowise

Drag & drop UI to build your customized LLM flow
https://flowiseai.com
Apache License 2.0
27.42k stars 14.17k forks source link

[FEATURE] Kubernetes deployment + CRD #1706

Open yairyairyair opened 5 months ago

yairyairyair commented 5 months ago

Describe the feature you'd like Would like flowise to have better kubernetes deployment, currently its just a docker container. Would be easier if its still a docker container however when deploying a flow it will create a CRD that deploys its own container, maybe something like this:

apiVersion: 'flowiseai.com/v1alpha1' kind: 'LLMApp' spec: { flow: SomeFlowObjectOrSpecHere } status:{ address:{ url: 'https:// the deployed url' } }

That way even if the whole flowise container is crashing the app will still work since different container, giving more "Production ready" features, making flowise move closer towards prod-ready external apps instead of just internal apps.

Ideas:

HenryHengZJ commented 5 months ago

if you have it setup successfully with kubernetes, would be awesome if you can share the steps!

yairyairyair commented 5 months ago

dont have it currently, its a feature that i want. what i do now is just knative service with flowiseai/flowise docker container i am talking about the main container "spawning" new containers that serve only a single flow each. can be done in kubernetes easily via a controller or operator with a CRD

Padarn commented 4 months ago

There is a helm chart here: https://github.com/cowboysysop/charts/tree/master/charts/flowise (I haven't used it yet). Would a PR adding a helm chart and instructions be something you'd want to have?