opea-project / GenAIInfra

Containerization and cloud native suite for OPEA
Apache License 2.0
16 stars 22 forks source link

Support configurable GenAI microservice components #49

Open mkbhanda opened 1 month ago

mkbhanda commented 1 month ago

We would like to use the Helm charts for the individual microservices in in confidential and non-confidential environments, ideally being able to specify the container runtime, for example Kata/CoCo. Confidential Clusters will be supported transparently by way of the Kubernetes cluster config. We might also want to make this input a part of the pipeline language via key-value pairs. Discuss design and implementation.