feat: staying on Hadoop conversions - Githubissues

GoogleCloudPlatform / oozie-to-airflow

Oozie Workflow to Airflow DAGs migration tool

Apache License 2.0

87 stars 50 forks source link

feat: staying on Hadoop conversions #688

Closed yoyomeng2 closed 1 year ago

yoyomeng2 commented 2 years ago

changes after testing sample jobs
get tests passing, remove git.sh tests
move out dataproc spark
render as SparkSubmitOperator
remove xdist b/c sporadic test issues
fix spark template tests, prep for shell changes
renames
match name
fix gcp template
fix oozie conv test
bash operator with no gcloud...pig prefix

Make sure you have checked all steps below and that above description is correct.

Github issue

[ ] My PR addresses the following Issue issue and references it in commit message.

Tests

[ ] My PR has unit tests testing the functionality (or I explained why it needs no tests)

Commits

[ ] My commits reference the issue in the message using: Fixes #XXX /Closes #XXX or similar.

Documentation

[ ] My PR adds documentation that describes how to use it (or I explained why it needs no docs)

google-cla[bot] commented 2 years ago

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.