Fix set_s3_env_vars_to_component in kfp v2.

IBM / data-prep-kit

Open source project for data preparation of LLM application builders

https://ibm.github.io/data-prep-kit/

Apache License 2.0

307 stars 134 forks source link

Fix set_s3_env_vars_to_component in kfp v2. #806

Closed revit13 closed 5 days ago

revit13 commented 5 days ago

Why are these changes needed?

set_s3_env_vars_to_component in kfp v2 accepts env2key dict that is shared between the function invocation. This implementation can lead to errors, especially when the function is called multiple times, sometimes with a prefix. This PR fixes that.