search

LangStream / langstream

LangStream. Event-Driven Developer Platform for Building and Running LLM AI Apps. Powered by Kubernetes and Kafka.
https://langstream.ai
Apache License 2.0
386 stars 28 forks source link

Allow runtime upgrade of existing applications #750

Open nicoloboschi opened 9 months ago

nicoloboschi commented 9 months ago

Currently once you deploy your application, the operator will never update the runtime image version, even if the app specs are updated. This is done on purpose, to ensure consistency overtime of an application.

With the new stateful applications, it might be tricky to delete and recreate an application because the disk is not retained. It becomes hard to upgrade the runtime image version without impacting the application itself.

One possible solution would be to add a flag in the update command to also refresh the new docker image (if the operator has a new one configured). In that case, the image would be modified and all the pods restarted

eolivelli commented 9 months ago

I second the solution.

It will reflect into a new parameter in the API and probably in the CRD?