search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.4k stars 3.97k forks source link

doc [environment variables]: explain which unit work for setting resource related variables #14307

Open alafanechere opened 2 years ago

alafanechere commented 2 years ago

Multiple user reached out to us asking how to properly set up the following environment variable: 

JOB_MAIN_CONTAINER_CPU_REQUEST=
JOB_MAIN_CONTAINER_CPU_LIMIT=
JOB_MAIN_CONTAINER_MEMORY_REQUEST=
JOB_MAIN_CONTAINER_MEMORY_LIMIT=

They should use the unit specified by docker-compose documentation:

Most of these options take a positive integer, followed by a suffix of b, k, m, g, to indicate bytes, kilobytes, megabytes, or gigabytes.

alafanechere commented 2 years ago

A related forum topic for reference

Amruta-Ranade commented 1 year ago

Hey, @alafanechere which docs need to be updated?

khoadaniel commented 12 months ago

Hi guys, This is the doc that needs to be clarified regarding which units to be used: https://docs.airbyte.com/operator-guides/configuring-airbyte/