Airflow SFTPToS3Operator file exist check

apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

https://airflow.apache.org/

Apache License 2.0

37.12k stars 14.31k forks source link

Airflow SFTPToS3Operator file exist check #40576

Open gaurav7261 opened 4 months ago

gaurav7261 commented 4 months ago

Description

currently operator fail in case file not found on sftp,can we have one parameter for user to configure it like fail_on_file_not_exist ?

Use case/motivation

this way, user will able to configure the parameter and operator will not fail in case of sftp file not exist

Related issues

No response

Are you willing to submit a PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

boring-cyborg[bot] commented 4 months ago

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

gaurav7261 commented 4 months ago

@potiuk is it fine ? can I start work on this

potiuk commented 4 months ago

Sure. You do not need to ask for permission - just start - any meaningful discusion on it might happen when we see PR.