LamaAni / KubernetesJobOperator

An airflow operator that executes a task in a kubernetes cluster, given a kubernetes yaml configuration or an image refrence.
58 stars 8 forks source link

Fixed distro setup to include other files. #11

Closed LamaAni closed 4 years ago

LamaAni commented 4 years ago

Major version change (1.0.1)

Fixes:

  1. Added support for python 3.6
  2. Added support for google composer.
  3. Moved threading to external PiPy package [zthreading.py] (https://pypi.org/project/zthreading/).
  4. Moved to use a new kube rest api interface, which dose direct api calls (via the kuberntes package).
  5. Allow to run multiple object deployments (i.e. same as kubectl apply).
  6. Added support for Pods and Jobs.
  7. Added support for Custom Kubernetes Controllers (specialized kinds)
  8. Fixed internal reference to kube_api
  9. Fixed internal reference to templates.

Missing:

  1. Readme updates.

Breaking changes:

  1. Added/Removed/Changed arguments in KubernetesJobOperator. (See list below)
  2. Added/Removed/Changed arguments in KubernetesLegacyJobOperator. (See list below)

Changed arguments in KubernetesJobOperator:

  1. Changed job_yaml -> body
  2. Changed job_yaml_fielpath -> body_filepath
  3. Removed the ability to send unnamed args.

Changed arguments in KuberentesLegacyJobOperator:

  1. Changed job_yaml -> body
    1. Changed job_yaml_fielpath -> body_filepath