search

GoogleCloudPlatform / flink-on-k8s-operator

[DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
Apache License 2.0
658 stars 266 forks source link

Require support pyflink jobs #370

Open sharkdtu opened 3 years ago

sharkdtu commented 3 years ago

Currently, the flink operator can only support submiting jobs by jar. its submit command is as follows:

flink run --jobmanager xxx --class xxx  xxx.jar args

But, when we need to submit pyflink jobs, its submit command is as follows:

flink run --jobmanager xxx -py xxx.py args
functicons commented 3 years ago

Thanks for the proposal! It should be easy, we just need to extend the CRD. If you can make the change, I'll welcome your PR, thanks!

danxian-baiheng commented 3 years ago

hey, I would like to do this. I think I need to do these things：

  1. change the CRD definition, add some fields for python jobs
  2. change flinkcluster_converter.go, generate a jobSubmmiter of job spec for python jobs.
  3. change flinkcluster_submit_job_script.go, Add recognition of task type and submit python task correctly。

Is this idea correct? Is there anything missing?