Open kokleong9406 opened 2 years ago
Hi @kokleong9406,
I think it can be related to running CWL-Airflow inside docker. For docker run
there is a --user
parameter. I believe something similar can be provided in the docker-compose file.
Let me know if this information was useful
Hi, for security reason, I have to use Apache Airflow v2.3.3 to with cwl-airflow because I would like to use the flag "run_as_user" defined in "default_args". It is a feature that allows an Airflow task to be ran by another Unix-user. More details can refer here: airflow impersonation
So I face this error "PID of job runner does not match" when I tried to run a workflow in a docker container
I do not face this error when I tried to run the same workflow in my local host though.
Below are some of the info that I think might be helpful to resolve the issue. My list of Python packages:
For the Dockerfile and docker-compose file, I used your templates, with slight modification to it. Below are some of the important info:
I am suspecting that this issue is caused by myself running a workflow in a docker container. So far I have not seen anyone mentioned about this issue in the Airflow github.