Open brandon-powers opened 1 month ago
Thank you for opening this feature request!! Contributions are welcomed for this! :)
Thank you for opening this feature request!! Contributions are welcomed for this! :)
Sounds great! Started working on the chart, will open a PR here for review when ready.
Just want to mention that this is now managed by #673
Prerequisites
What are you trying to do that currently feels hard or impossible?
👋
Based on the existing documentation, we can create a Helm chart for making deployments of the MCP toolbox easier & standardized on Kubernetes.
As an example of a potential benefit, we could have
values
options for # of replicas (servers), horizontal auto-scaling (HPA), explicit resources, etc. for increased reliability.Suggested Solution(s)
helm/genai-toolbox/
orhelm-charts/
as a new top-level directory, containing:Deployment
- for the MCP server(s)topologySpreadConstraints
& [anti-]affinities to run instances across AWS AZs / GCP Zones.Service
- for accessHorizontalPodAutoscaler
- for the auto-scaling optionServiceAccount
- can bring-your-own or option to define it in chartSecret
- fortools.yaml
Alternatives Considered
No response
Additional Details
I'd be interested in contributing this; wanted to raise it for feedback.