Implement exploding variables for kubeflow backend when variables are not pickleable between steps.

SAME-Project / same-project

https://sameproject.ml/

Apache License 2.0

20 stars 8 forks source link

Implement exploding variables for kubeflow backend when variables are not pickleable between steps. #110

Closed Bubblyworld closed 2 years ago

Bubblyworld commented 2 years ago

Currently when serialising context between steps we delete anything that can't be pickled. This change implements ExplodingVariables, which raise a given exception whenever they are used, and uses them to replace unpickleable stuff so that users at least know why their variable disappeared between steps.

github-actions[bot] commented 2 years ago

Unit Test Results

  1 files   1 suites 42s :stopwatch: 64 tests 51 :heavy_check_mark: 13 :zzz: 0 :x:

Results for commit 51108435.