issues
search
Netflix
/
metaflow
Open Source Platform for developing, scaling and deploying serious ML, AI, and data science systems
https://metaflow.org
Apache License 2.0
8.09k
stars
762
forks
source link
[refactor-jobsets] refactor to new implementation
#1914
Closed
valayDave
closed
2 months ago
valayDave
commented
3 months ago
Some changes stemming from Netflix/metaflow#1854
reorder imports
changes to env var prefixes + id generation
Abstraction over Jobset Spec
Create general abstraction and copy style of how we create jobspec for native k8s jobs.
simplified the implementation.
similar pattern/trend to follow for argo
remove older implementation
@parallel metadata from k8s decorator - added attempt to MetaDatum tags - We didn't have this earlier
romain-intel
commented
2 months ago
This is all in a plugin so all good for me.