Feat/enable concurrent runs

[jan-zajac-dt]

Description

DRAFT Adding an additional environment variable ADDITIONAL_SUFFIX so that GCS asset paths and BQ tables that get overwritten can be suffixed with it, permitting multiple developers on the same project to run pipelines without deleting each others' changes.

I have also tried using pipeline arguments in the compiler for the pipeline. In my opinion this is a worse solution as:

1. It introduces a lot of additional args to be ran in the Makefile for compile-pipeline, sync-assets and run commands
2. We already use environment variables for many of the pipeline arguments.

If approach is ok, I will extend to other pipelines (as draft only includes XGBoost training) and update documentation where needed.

How has this been tested?

2 successful pipelines that (with/without ADDITIONAL SUFFIX environment variable set )

Checklist

• [ ] I have commented my code, particularly in hard-to-understand areas
• [ ] I have successfully run the E2E tests, and have included the links to the pipeline runs below
• [ ] I have added tests that prove my fix is effective or that my feature works
• [ ] New and existing unit tests pass locally with my changes
• [ ] I have updated any relevant documentation to reflect my changes
• [ ] I have assigned a reviewer and messaged them

Pipeline run links:

• without ADDITIONAL_SUFFIX variable
• with ADDITIONAL_SUFFIX variable

[google-cla[bot]]

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.