Add exploding variable for variables that use too much memory in kubeflow backend.

SAME-Project / same-project

https://sameproject.ml/

Apache License 2.0

20 stars 8 forks source link

Add exploding variable for variables that use too much memory in kubeflow backend. #113

Closed Bubblyworld closed 2 years ago

Bubblyworld commented 2 years ago

Replaces variables that use too much memory (>50MB) with an exploding variable to prevent things like large datasets and models from overloading the context between SAME steps.