search

kubeflow-kale / kale

Kubeflow’s superfood for Data Scientists
http://kubeflow-kale.github.io
Apache License 2.0
632 stars 128 forks source link

Support for leveraging reusable components #146

Open alexlatchford opened 4 years ago

alexlatchford commented 4 years ago

Following this guide allows a user of the KFP SDK the ability to use the kfp.components.load_component_from_url API to pull in reusable components as a part of a pipeline. Maybe I've missed this feature with Kale but it'd be awesome to handle this maybe via Notebook Cell annotations?

davidspek commented 4 years ago

Looking at the component development page it doesn't seem like it would be very difficult to add this functionality. I will be looking at this in the near future hopefully. What would be more interesting in my eyes is the functionality to have Kale create a pipeline component from a cell or notebook. It would need to create a docker image and have a registry (with credentials) that it should push the image too. For the component.yaml I'm not sure how much of that can be automated and what all would need manual input from the user.