thesuperzapper
commented
3 years ago @upkash you usually only get errors like alembic.script.revision.ResolutionError: No such revision or branch 'a13f7613ad25' when you try and downgrade your airflow version.
You will need to recreate/reset your airflow database to fix this, the easiest way to do that, is to delete and recreate your airflow namespace. (NOTE: you will lose any DAG history)
Otherwise, you will need to manually drop the postgress tables used by airflow.
upkash
What is the bug?
[[A clear description of the bug]] db_migrations fails when using custom docker image to update DAGs, which in turn causes the rest of the pods to remain stuck initializing since they wait for db_migrations to complete.
What version of the chart are you using?:
I am using version
1.21.2What is your Kubernetes Version?:
Client Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.3", GitCommit:"ca643a4d1f7bfe34773c74f79527be4afd95bf39", GitTreeState:"clean", BuildDate:"2021-07-15T21:04:39Z", GoVersion:"go1.16.6", Compiler:"gc", Platform:"darwin/amd64"} Server Version: version.Info{Major:"1", Minor:"21", GitVersion:"v1.21.2", GitCommit:"092fbfbf53427de67cac1e9fa54aaa09a28371d7", GitTreeState:"clean", BuildDate:"2021-06-16T12:53:14Z", GoVersion:"go1.16.5", Compiler:"gc", Platform:"linux/amd64"}
What is your Helm version?:
version.BuildInfo{Version:"v3.6.3", GitCommit:"d506314abfb5d21419df8c7e7e68012379db2354", GitTreeState:"dirty", GoVersion:"go1.16.5"}
Traceback from airflow-db-migrations-pod
Please copy your custom Helm values file:
Expand
```yaml ######################################## ## CONFIG | Airflow Configs ######################################## airflow: ## if we use legacy 1.10 airflow commands ## legacyCommands: false ## configs for the airflow container image ## image: repository: uprakash2/airflow tag: latest pullPolicy: IfNotPresent pullSecret: "" ## the airflow executor type to use ## - allowed values: "CeleryExecutor", "KubernetesExecutor", "CeleryKubernetesExecutor" ## - customize the "KubernetesExecutor" pod-template with `airflow.kubernetesPodTemplate.*` ## executor: CeleryExecutor ## the fernet encryption key (sets `AIRFLOW__CORE__FERNET_KEY`) ## - [WARNING] you must change this value to ensure the security of your airflow ## - set `AIRFLOW__CORE__FERNET_KEY` with `airflow.extraEnv` from a Secret to avoid storing this in your values ## - use this command to generate your own fernet key: ## python -c "from cryptography.fernet import Fernet; FERNET_KEY = Fernet.generate_key().decode(); print(FERNET_KEY)" ## fernetKey: "7T512UXSSmBOkpWimFHIVb8jK6lfmSAvx4mO6Arehnc=" ## the secret_key for flask (sets `AIRFLOW__WEBSERVER__SECRET_KEY`) ## - [WARNING] you must change this value to ensure the security of your airflow ## - set `AIRFLOW__WEBSERVER__SECRET_KEY` with `airflow.extraEnv` from a Secret to avoid storing this in your values ## webserverSecretKey: "THIS IS UNSAFE!" ## environment variables for airflow configs ## - airflow env-vars are structured: "AIRFLOW__{config_section}__{config_name}" ## - airflow configuration reference: ## https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html ## ## ____ EXAMPLE _______________ ## config: ## # dag configs ## AIRFLOW__CORE__LOAD_EXAMPLES: "False" ## AIRFLOW__SCHEDULER__DAG_DIR_LIST_INTERVAL: "30" ## ## # email configs ## AIRFLOW__EMAIL__EMAIL_BACKEND: "airflow.utils.email.send_email_smtp" ## AIRFLOW__SMTP__SMTP_HOST: "smtpmail.example.com" ## AIRFLOW__SMTP__SMTP_MAIL_FROM: "admin@example.com" ## AIRFLOW__SMTP__SMTP_PORT: "25" ## AIRFLOW__SMTP__SMTP_SSL: "False" ## AIRFLOW__SMTP__SMTP_STARTTLS: "False" ## ## # domain used in airflow emails ## AIRFLOW__WEBSERVER__BASE_URL: "http://airflow.example.com" ## ## # ether environment variables ## HTTP_PROXY: "http://proxy.example.com:8080" ## config: {} ## a list of users to create ## - templates can ONLY be used in: `password`, `email`, `firstName`, `lastName` ## - templates used a bash-like syntax: ${MY_USERNAME}, $MY_USERNAME ## - templates are defined in `usersTemplates` ## users: - username: admin password: admin role: Admin email: admin@example.com firstName: admin lastName: admin ## bash-like templates to be used in `airflow.users` ## - [WARNING] if a Secret or ConfigMap is missing, the sync Pod will crash ## - [WARNING] all keys must match the regex: ^[a-zA-Z_][a-zA-Z0-9_]*$ ## ## ____ EXAMPLE _______________ ## usersTemplates ## MY_USERNAME: ## kind: configmap ## name: my-configmap ## key: username ## MY_PASSWORD: ## kind: secret ## name: my-secret ## key: password ## usersTemplates: {} ## if we create a Deployment to perpetually sync `airflow.users` ## - when `true`, users are updated in real-time, as ConfigMaps/Secrets change ## - when `true`, users changes from the WebUI will be reverted automatically ## - when `false`, users will only update one-time, after each `helm upgrade` ## usersUpdate: true ## a list airflow connections to create ## - templates can ONLY be used in: `host`, `login`, `password`, `schema`, `extra` ## - templates used a bash-like syntax: ${AWS_ACCESS_KEY} or $AWS_ACCESS_KEY ## - templates are defined in `connectionsTemplates` ## ## ____ EXAMPLE _______________ ## connections: ## - id: my_aws ## type: aws ## description: my AWS connection ## extra: |- ## { "aws_access_key_id": "${AWS_KEY_ID}", ## "aws_secret_access_key": "${AWS_ACCESS_KEY}", ## "region_name":"eu-central-1" } ## connections: [] ## bash-like templates to be used in `airflow.connections` ## - see docs for `airflow.usersTemplates` ## connectionsTemplates: {} ## if we create a Deployment to perpetually sync `airflow.connections` ## - see docs for `airflow.usersUpdate` ## connectionsUpdate: true ## a list airflow variables to create ## - templates can ONLY be used in: `value` ## - templates used a bash-like syntax: ${MY_VALUE} or $MY_VALUE ## - templates are defined in `connectionsTemplates` ## ## ____ EXAMPLE _______________ ## variables: ## - key: "var_1" ## value: "my_value_1" ## - key: "var_2" ## value: "my_value_2" ## variables: [] ## bash-like templates to be used in `airflow.variables` ## - see docs for `airflow.usersTemplates` ## variablesTemplates: {} ## if we create a Deployment to perpetually sync `airflow.variables` ## - see docs for `airflow.usersUpdate` ## variablesUpdate: true ## a list airflow pools to create ## ## ____ EXAMPLE _______________ ## pools: ## - name: "pool_1" ## description: "example pool with 5 slots" ## slots: 5 ## - name: "pool_2" ## description: "example pool with 10 slots" ## slots: 10 ## pools: [] ## if we create a Deployment to perpetually sync `airflow.pools` ## - see docs for `airflow.usersUpdate` ## poolsUpdate: true ## default nodeSelector for airflow Pods (is overridden by pod-specific values) ## - docs for nodeSelector: ## https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector ## defaultNodeSelector: {} ## default affinity configs for airflow Pods (is overridden by pod-specific values) ## - spec for Affinity: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#affinity-v1-core ## defaultAffinity: {} ## default toleration configs for airflow Pods (is overridden by pod-specific values) ## - spec for Toleration: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#toleration-v1-core ## defaultTolerations: [] ## default securityContext configs for airflow Pods (is overridden by pod-specific values) ## - spec for PodSecurityContext: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#podsecuritycontext-v1-core ## defaultSecurityContext: ## sets the filesystem owner group of files/folders in mounted volumes ## this does NOT give root permissions to Pods, only the "root" group fsGroup: 0 ## extra annotations for airflow Pods ## podAnnotations: {} ## extra pip packages to install in airflow Pods ## ## ____ EXAMPLE _______________ ## extraPipPackages: ## - "SomeProject==1.0.0" ## extraPipPackages: [] ## extra environment variables for the airflow Pods ## - spec for EnvVar: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#envvar-v1-core ## extraEnv: [] ## extra containers for the airflow Pods ## - spec for Container: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#container-v1-core ## extraContainers: [] ## extra VolumeMounts for the airflow Pods ## - spec for VolumeMount: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volumemount-v1-core ## extraVolumeMounts: [] ## extra Volumes for the airflow Pods ## - spec for Volume: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volume-v1-core ## extraVolumes: [] ######################################## ## FILE | airflow_local_settings.py ######################################## ## localSettings: ## the full content of the `airflow_local_settings.py` file (as a string) ## - docs for airflow cluster policies: ## https://airflow.apache.org/docs/apache-airflow/stable/concepts/cluster-policies.html ## ## ____ EXAMPLE _______________ ## stringOverride: | ## # use a custom `xcom_sidecar` image for KubernetesPodOperator() ## from airflow.kubernetes.pod_generator import PodDefaults ## PodDefaults.SIDECAR_CONTAINER.image = "gcr.io/PROJECT-ID/custom-sidecar-image" ## stringOverride: "" ## the name of a Secret containing a `airflow_local_settings.py` key ## - if set, this disables `airflow.localSettings.stringOverride` ## existingSecret: "" ######################################## ## FILE | pod_template.yaml ######################################## ## - generates a file for `AIRFLOW__KUBERNETES__POD_TEMPLATE_FILE` ## - the `dags.gitSync` values will create a git-sync init-container in the pod ## - the `airflow.extraPipPackages` will NOT be installed ## kubernetesPodTemplate: ## the full content of the pod-template file (as a string) ## - [WARNING] all other `kubernetesPodTemplate.*` are disabled when this is set ## - docs for pod-template file: ## https://airflow.apache.org/docs/apache-airflow/stable/executor/kubernetes.html#pod-template-file ## ## ____ EXAMPLE _______________ ## stringOverride: |- ## apiVersion: v1 ## kind: Pod ## spec: ... ## stringOverride: "" ## resource requests/limits for the Pod template "base" container ## - spec for ResourceRequirements: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#resourcerequirements-v1-core ## resources: {} ## the nodeSelector configs for the Pod template ## - docs for nodeSelector: ## https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector ## nodeSelector: {} ## the affinity configs for the Pod template ## - spec for Affinity: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#affinity-v1-core ## affinity: {} ## the toleration configs for the Pod template ## - spec for Toleration: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#toleration-v1-core ## tolerations: [] ## annotations for the Pod template podAnnotations: {} ## the security context for the Pod template ## - spec for PodSecurityContext: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#podsecuritycontext-v1-core ## securityContext: {} ## extra pip packages to install in the Pod template ## ## ____ EXAMPLE _______________ ## extraPipPackages: ## - "SomeProject==1.0.0" ## extraPipPackages: [] ## extra VolumeMounts for the Pod template ## - spec for VolumeMount: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volumemount-v1-core ## extraVolumeMounts: [] ## extra Volumes for the Pod template ## - spec for Volume: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volume-v1-core ## extraVolumes: [] ######################################## ## COMPONENT | db-migrations Deployment ######################################## dbMigrations: ## if the db-migrations Deployment/Job is created ## - [WARNING] if `false`, you have to MANUALLY run `airflow db upgrade` when required ## enabled: true ## if a post-install helm Job should be used (instead of a Deployment) ## - [WARNING] setting `true` will NOT work with the helm `--wait` flag, ## this is because post-install helm Jobs run AFTER the main resources become Ready, ## which will cause a deadlock, as other resources require db-migrations to become Ready ## runAsJob: false ## resource requests/limits for the db-migrations Pods ## - spec for ResourceRequirements: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#resourcerequirements-v1-core ## resources: {} ## the nodeSelector configs for the db-migrations Pods ## - docs for nodeSelector: ## https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector ## nodeSelector: {} ## the affinity configs for the db-migrations Pods ## - spec for Affinity: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#affinity-v1-core ## affinity: {} ## the toleration configs for the db-migrations Pods ## - spec for Toleration: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#toleration-v1-core ## tolerations: [] ## the security context for the db-migrations Pods ## - spec for PodSecurityContext: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#podsecuritycontext-v1-core ## securityContext: {} ## Pod labels for the db-migrations Deployment ## podLabels: {} ## annotations for the db-migrations Deployment/Job ## annotations: {} ## Pod annotations for the db-migrations Deployment/Job ## podAnnotations: {} ## if we add the annotation: "cluster-autoscaler.kubernetes.io/safe-to-evict" = "true" ## safeToEvict: true ## the number of seconds between checks for unapplied db migrations ## - only applies if `airflow.dbMigrations.runAsJob` is `false` ## checkInterval: 300 ######################################## ## COMPONENT | Sync Deployments ######################################## ## - used by the Deployments/Jobs used by `airflow.{connections,pools,users,variables}` ## sync: ## resource requests/limits for the sync Pods ## - spec for ResourceRequirements: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#resourcerequirements-v1-core ## resources: {} ## the nodeSelector configs for the sync Pods ## - docs for nodeSelector: ## https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector ## nodeSelector: {} ## the affinity configs for the sync Pods ## - spec for Affinity: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#affinity-v1-core ## affinity: {} ## the toleration configs for the sync Pods ## - spec for Toleration: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#toleration-v1-core ## tolerations: [] ## the security context for the sync Pods ## - spec for PodSecurityContext: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#podsecuritycontext-v1-core ## securityContext: {} ## Pod labels for the sync Deployments/Jobs ## podLabels: {} ## annotations for the sync Deployments/Jobs ## annotations: {} ## Pod annotations for the sync Deployments/Jobs ## podAnnotations: {} ## if we add the annotation: "cluster-autoscaler.kubernetes.io/safe-to-evict" = "true" ## safeToEvict: true ################################### ## COMPONENT | Airflow Scheduler ################################### scheduler: ## the number of scheduler Pods to run ## - if you set this >1 we recommend defining a `scheduler.podDisruptionBudget` ## replicas: 1 ## resource requests/limits for the scheduler Pod ## - spec of ResourceRequirements: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#resourcerequirements-v1-core ## resources: {} ## the nodeSelector configs for the scheduler Pods ## - docs for nodeSelector: ## https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector ## nodeSelector: {} ## the affinity configs for the scheduler Pods ## - spec of Affinity: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#affinity-v1-core ## affinity: {} ## the toleration configs for the scheduler Pods ## - spec of Toleration: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#toleration-v1-core ## tolerations: [] ## the security context for the scheduler Pods ## - spec of PodSecurityContext: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#podsecuritycontext-v1-core ## securityContext: {} ## labels for the scheduler Deployment ## labels: {} ## Pod labels for the scheduler Deployment ## podLabels: {} ## annotations for the scheduler Deployment ## annotations: {} ## Pod annotations for the scheduler Deployment ## podAnnotations: {} ## if we add the annotation: "cluster-autoscaler.kubernetes.io/safe-to-evict" = "true" ## safeToEvict: true ## configs for the PodDisruptionBudget of the scheduler ## podDisruptionBudget: ## if a PodDisruptionBudget resource is created for the scheduler ## enabled: false ## the maximum unavailable pods/percentage for the scheduler ## maxUnavailable: "" ## the minimum available pods/percentage for the scheduler ## minAvailable: "" ## sets `airflow --num_runs` parameter used to run the airflow scheduler ## numRuns: -1 ## configs for the scheduler Pods' liveness probe ## - `periodSeconds` x `failureThreshold` = max seconds a scheduler can be unhealthy ## livenessProbe: enabled: true initialDelaySeconds: 10 periodSeconds: 30 timeoutSeconds: 10 failureThreshold: 5 ## extra pip packages to install in the scheduler Pods ## ## ____ EXAMPLE _______________ ## extraPipPackages: ## - "SomeProject==1.0.0" ## extraPipPackages: [] ## extra VolumeMounts for the scheduler Pods ## - spec of VolumeMount: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volumemount-v1-core ## extraVolumeMounts: [] ## extra Volumes for the scheduler Pods ## - spec of Volume: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volume-v1-core ## extraVolumes: [] ## extra init containers to run in the scheduler Pods ## - spec of Container: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#container-v1-core ## extraInitContainers: [] ################################### ## COMPONENT | Airflow Webserver ################################### web: ######################################## ## FILE | webserver_config.py ######################################## ## webserverConfig: ## the full content of the `webserver_config.py` file (as a string) ## - docs for Flask-AppBuilder security configs: ## https://flask-appbuilder.readthedocs.io/en/latest/security.html ## ## ____ EXAMPLE _______________ ## stringOverride: | ## from airflow import configuration as conf ## from flask_appbuilder.security.manager import AUTH_DB ## ## # the SQLAlchemy connection string ## SQLALCHEMY_DATABASE_URI = conf.get('core', 'SQL_ALCHEMY_CONN') ## ## # use embedded DB for auth ## AUTH_TYPE = AUTH_DB ## stringOverride: "" ## the name of a Secret containing a `webserver_config.py` key ## existingSecret: "" ## the number of web Pods to run ## - if you set this >1 we recommend defining a `web.podDisruptionBudget` ## replicas: 1 ## resource requests/limits for the web Pod ## - spec for ResourceRequirements: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#resourcerequirements-v1-core ## resources: {} ## the nodeSelector configs for the web Pods ## - docs for nodeSelector: ## https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector ## nodeSelector: {} ## the affinity configs for the web Pods ## - spec for Affinity: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#affinity-v1-core ## affinity: {} ## the toleration configs for the web Pods ## - spec for Toleration: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#toleration-v1-core ## tolerations: [] ## the security context for the web Pods ## - spec for PodSecurityContext: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#podsecuritycontext-v1-core ## securityContext: {} ## labels for the web Deployment ## labels: {} ## Pod labels for the web Deployment ## podLabels: {} ## annotations for the web Deployment ## annotations: {} ## Pod annotations for the web Deployment ## podAnnotations: {} ## if we add the annotation: "cluster-autoscaler.kubernetes.io/safe-to-evict" = "true" ## safeToEvict: true ## configs for the PodDisruptionBudget of the web Deployment ## podDisruptionBudget: ## if a PodDisruptionBudget resource is created for the web Deployment ## enabled: false ## the maximum unavailable pods/percentage for the web Deployment ## maxUnavailable: "" ## the minimum available pods/percentage for the web Deployment ## minAvailable: "" ## configs for the Service of the web Pods ## service: annotations: {} sessionAffinity: "None" sessionAffinityConfig: {} type: ClusterIP externalPort: 8080 loadBalancerIP: "" loadBalancerSourceRanges: [] nodePort: http: "" ## configs for the web Pods' readiness probe ## readinessProbe: enabled: true initialDelaySeconds: 10 periodSeconds: 10 timeoutSeconds: 5 failureThreshold: 6 ## configs for the web Pods' liveness probe ## livenessProbe: enabled: true initialDelaySeconds: 10 periodSeconds: 10 timeoutSeconds: 5 failureThreshold: 6 ## extra pip packages to install in the web Pods ## ## ____ EXAMPLE _______________ ## extraPipPackages: ## - "SomeProject==1.0.0" ## extraPipPackages: [] ## extra VolumeMounts for the web Pods ## - spec for VolumeMount: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volumemount-v1-core ## extraVolumeMounts: [] ## extra Volumes for the web Pods ## - spec for Volume: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volume-v1-core ## extraVolumes: [] ################################### ## COMPONENT | Airflow Workers ################################### workers: ## if the airflow workers StatefulSet should be deployed ## enabled: true ## the number of worker Pods to run ## - if you set this >1 we recommend defining a `workers.podDisruptionBudget` ## - this is the minimum when `workers.autoscaling.enabled` is true ## replicas: 1 ## resource requests/limits for the worker Pod ## - spec for ResourceRequirements: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#resourcerequirements-v1-core ## resources: {} ## the nodeSelector configs for the worker Pods ## - docs for nodeSelector: ## https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector ## nodeSelector: {} ## the affinity configs for the worker Pods ## - spec for Affinity: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#affinity-v1-core ## affinity: {} ## the toleration configs for the worker Pods ## - spec for Toleration: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#toleration-v1-core ## tolerations: [] ## the security context for the worker Pods ## - spec for PodSecurityContext: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#podsecuritycontext-v1-core ## securityContext: {} ## labels for the worker StatefulSet ## labels: {} ## Pod labels for the worker StatefulSet ## podLabels: {} ## annotations for the worker StatefulSet ## annotations: {} ## Pod annotations for the worker StatefulSet ## podAnnotations: {} ## if we add the annotation: "cluster-autoscaler.kubernetes.io/safe-to-evict" = "true" ## safeToEvict: true ## configs for the PodDisruptionBudget of the worker StatefulSet ## podDisruptionBudget: ## if a PodDisruptionBudget resource is created for the worker StatefulSet ## enabled: false ## the maximum unavailable pods/percentage for the worker StatefulSet ## maxUnavailable: "" ## the minimum available pods/percentage for the worker StatefulSet ## minAvailable: "" ## configs for the HorizontalPodAutoscaler of the worker Pods ## - [WARNING] if using git-sync, ensure `dags.gitSync.resources` is set ## ## ____ EXAMPLE _______________ ## autoscaling: ## enabled: true ## maxReplicas: 16 ## metrics: ## - type: Resource ## resource: ## name: memory ## target: ## type: Utilization ## averageUtilization: 80 ## autoscaling: enabled: false maxReplicas: 2 metrics: [] ## configs for the celery worker Pods ## celery: ## if celery worker Pods are gracefully terminated ## - consider defining a `workers.podDisruptionBudget` to prevent there not being ## enough available workers during graceful termination waiting periods ## ## graceful termination process: ## 1. prevent worker accepting new tasks ## 2. wait AT MOST `workers.celery.gracefullTerminationPeriod` for tasks to finish ## 3. send SIGTERM to worker ## 4. wait AT MOST `workers.terminationPeriod` for kill to finish ## 5. send SIGKILL to worker ## gracefullTermination: false ## how many seconds to wait for tasks to finish before SIGTERM of the celery worker ## gracefullTerminationPeriod: 600 ## how many seconds to wait after SIGTERM before SIGKILL of the celery worker ## - [WARNING] tasks that are still running during SIGKILL will be orphaned, this is important ## to understand with KubernetesPodOperator(), as Pods may continue running ## terminationPeriod: 60 ## extra pip packages to install in the worker Pod ## ## ____ EXAMPLE _______________ ## extraPipPackages: ## - "SomeProject==1.0.0" ## extraPipPackages: [] ## extra VolumeMounts for the worker Pods ## - spec for VolumeMount: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volumemount-v1-core ## extraVolumeMounts: [] ## extra Volumes for the worker Pods ## - spec for Volume: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volume-v1-core ## extraVolumes: [] ################################### ## COMPONENT | Flower ################################### flower: ## if the airflow flower UI should be deployed ## enabled: true ## the number of flower Pods to run ## - if you set this >1 we recommend defining a `flower.podDisruptionBudget` ## replicas: 1 ## resource requests/limits for the flower Pod ## - spec for ResourceRequirements: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#resourcerequirements-v1-core ## resources: {} ## the nodeSelector configs for the flower Pods ## - docs for nodeSelector: ## https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector ## nodeSelector: {} ## the affinity configs for the flower Pods ## - spec for Affinity: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#affinity-v1-core ## affinity: {} ## the toleration configs for the flower Pods ## - spec for Toleration: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#toleration-v1-core ## tolerations: [] ## the security context for the flower Pods ## - spec for PodSecurityContext: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#podsecuritycontext-v1-core ## securityContext: {} ## labels for the flower Deployment ## labels: {} ## Pod labels for the flower Deployment ## podLabels: {} ## annotations for the flower Deployment ## annotations: {} ## Pod annotations for the flower Deployment ## podAnnotations: {} ## if we add the annotation: "cluster-autoscaler.kubernetes.io/safe-to-evict" = "true" ## safeToEvict: true ## configs for the PodDisruptionBudget of the flower Deployment ## podDisruptionBudget: ## if a PodDisruptionBudget resource is created for the flower Deployment ## enabled: false ## the maximum unavailable pods/percentage for the flower Deployment ## maxUnavailable: "" ## the minimum available pods/percentage for the flower Deployment ## minAvailable: "" ## the name of a pre-created secret containing the basic authentication value for flower ## - this will override any value of `config.AIRFLOW__CELERY__FLOWER_BASIC_AUTH` ## basicAuthSecret: "" ## the key within `flower.basicAuthSecret` containing the basic authentication string ## basicAuthSecretKey: "" ## configs for the Service of the flower Pods ## service: annotations: {} type: ClusterIP externalPort: 5555 loadBalancerIP: "" loadBalancerSourceRanges: [] nodePort: http: ## configs for the flower Pods' readinessProbe probe ## readinessProbe: enabled: true initialDelaySeconds: 10 periodSeconds: 10 timeoutSeconds: 5 failureThreshold: 6 ## configs for the flower Pods' liveness probe ## livenessProbe: enabled: true initialDelaySeconds: 10 periodSeconds: 10 timeoutSeconds: 5 failureThreshold: 6 ## extra pip packages to install in the flower Pod ## ## ____ EXAMPLE _______________ ## extraPipPackages: ## - "SomeProject==1.0.0" ## extraPipPackages: [] ## extra VolumeMounts for the flower Pods ## - spec for VolumeMount: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volumemount-v1-core ## extraVolumeMounts: [] ## extra Volumes for the flower Pods ## - spec for Volume: ## https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.20/#volume-v1-core ## extraVolumes: [] ################################### ## CONFIG | Airflow Logs ################################### logs: ## the airflow logs folder ## path: /opt/airflow/logs ## configs for the logs PVC ## persistence: ## if a persistent volume is mounted at `logs.path` ## enabled: false ## the name of an existing PVC to use ## existingClaim: "" ## sub-path under `logs.persistence.existingClaim` to use ## subPath: "" ## the name of the StorageClass used by the PVC ## - if set to "", then `PersistentVolumeClaim/spec.storageClassName` is omitted ## - if set to "-", then `PersistentVolumeClaim/spec.storageClassName` is set to "" ## storageClass: "" ## the access mode of the PVC ## - [WARNING] must be "ReadWriteMany" or airflow pods will fail to start ## accessMode: ReadWriteMany ## the size of PVC to request ## size: 1Gi ################################### ## CONFIG | Airflow DAGs ################################### dags: ## the airflow dags folder ## path: /opt/airflow/dags ## configs for the dags PVC ## persistence: ## if a persistent volume is mounted at `dags.path` ## enabled: false ## the name of an existing PVC to use ## existingClaim: "" ## sub-path under `dags.persistence.existingClaim` to use ## subPath: "" ## the name of the StorageClass used by the PVC ## - if set to "", then `PersistentVolumeClaim/spec.storageClassName` is omitted ## - if set to "-", then `PersistentVolumeClaim/spec.storageClassName` is set to "" ## storageClass: "" ## the access mode of the PVC ## - [WARNING] must be "ReadOnlyMany" or "ReadWriteMany" otherwise airflow pods will fail to start ## accessMode: ReadOnlyMany ## the size of PVC to request ## size: 1Gi ## configs for the git-sync sidecar (https://github.com/kubernetes/git-sync) ## gitSync: ## if the git-sync sidecar container is enabled ## enabled: false image: repository: k8s.gcr.io/git-sync/git-sync tag: v3.2.2 pullPolicy: IfNotPresent uid: 65533 gid: 65533 resources: {} ## the url of the git repo ## ## ____ EXAMPLE _______________ ## # https git repo ## repo: "https://github.com/USERNAME/REPOSITORY.git" ## ## ____ EXAMPLE _______________ ## # ssh git repo ## repo: "git@github.com:USERNAME/REPOSITORY.git" ## repo: "" ## the sub-path within your repo where dags are located ## - only dags under this path within your repo will be seen by airflow, ## (note, the full repo will still be cloned) ## repoSubPath: "" ## the git branch to check out ## branch: main ## the git revision (tag or hash) to check out ## revision: HEAD ## shallow clone with a history truncated to the specified number of commits ## depth: 1 ## the number of seconds between syncs ## syncWait: 60 ## the max number of seconds allowed for a complete sync ## syncTimeout: 120 ## the name of a pre-created Secret with git http credentials ## httpSecret: "" ## the key in `dags.gitSync.httpSecret` with your git username ## httpSecretUsernameKey: username ## the key in `dags.gitSync.httpSecret` with your git password/token ## httpSecretPasswordKey: password ## the name of a pre-created Secret with git ssh credentials ## sshSecret: "" ## the key in `dags.gitSync.sshSecret` with your ssh-key file ## sshSecretKey: id_rsa ## the string value of a "known_hosts" file (for SSH only) ## - [WARNING] known_hosts verification will be disabled if left empty, making you more ## vulnerable to repo spoofing attacks ## ## ____ EXAMPLE _______________ ## sshKnownHosts: |- ##