ArroyoSystems / arroyo

Distributed stream processing engine in Rust
https://arroyo.dev
Apache License 2.0
3.81k stars 220 forks source link

Allow setting worker environment variables in kubernetes #721

Closed mwylde closed 3 months ago

mwylde commented 3 months ago

Adds support for setting env vars on the kubernetes workers via config, for example:

configmap.yaml

apiVersion: v1
kind: ConfigMap
metadata:
  name: my-arroyo-config
data:
  config.yaml: |
    kubernetes-scheduler:
      worker:
        env:
          - name: AWS_DEFAULT_REGION
            value: us-east-1
          - name: AWS_ACCESS_KEY_ID
            value: "AJKSDJLAKJSDALKSJD"
          - name: AWS_SECRET_ACCESS_KEY
            value: "214124jHJhkjh1212aasd"

values.yaml

existingConfigMap: "my-arroyo-config"