Node selector and tolerations for job

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

https://airbyte.com

Other

15.55k stars 4.01k forks source link

Node selector and tolerations for job #10378

Open febarbosa182 opened 2 years ago

febarbosa182 commented 2 years ago

My environment is an EKS 1.21 with managed node groups with ARM. For airbyte we provisioned a specific node group with taints, and we installed it. But when we try to configure a source or destination, airbyte schedule a pod for this sync, at this point this pod try to start in another node and fall in error.

Screen Shot 2022-02-16 at 10 25 04 AM

stockymcstockface commented 2 years ago

Also looking forward to having this, I am using a dedicated node pool for airbyte and I wish to schedule those pods on the dedicated pool.

marcosmarxm commented 1 year ago

@febarbosa182 did you check latest Helm deployment?